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APPARATUS AND METHOD FOR RENDERING SURFACES IN 3D 

COMPUTER GRAPHICS 

The present invention relates to the field of three- 
5 dimensional (3D) computer graphics and, more 
particularly, to the rendering of object surfaces. 

In 3D computer graphics, three-dimensional objects are 
commonly represented using a mesh of polygons which 

10 closely follow the surface of the object. The more 
complex the object surface, the more polygons are 
required to model it accurately. However, as the number 
of polygons increases, the processing operations which 
must be carried out to display an image of the object 

15 increase, since each polygon must be processed, and the 
storage capacity required to store all of the polygons 
also increases. Accordingly, many 3D graphics systems 
attempt to use as few polygons as possible. One problem 
with such systems, therefore, is that surface curvature 

20 is lost due to the low polygon representation. This 
causes images of the model to appear faceted instead of 
smooth • 

"Creation and Smooth-Shading of Steiner Patch 
25 Tessellations" by D.E. Breen in 1986 Proceedings Fall 
Joint Computer Conference, pages 931-940, IEEE Catalog 
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Number 86CH2345-7, describes a method of shading a three- 
dimensional surface in which the surface is originally 
modelled as a particular type of biparametric patch, 
namely a superellipsoid, the superellipsoid is uniformly 
5 subdivided into triangles, and each triangle is 
approximated with a steiner patch to produce a continuous 
mesh of steiner patches. In order to render the 
resulting mesh, the steiner patches are ray traced, and, 
when a patch is intersected by a ray, the coordinates and 

10 a normal at the intersection are determined. The result 
is said to be a method which offers the possibility of 
reducing the computational expense and time to produce 
high quality ray traced computer animation. However, the 
method suffers from a number of problems for general 

15 purpose, and in particular real-time, computer graphics. 
For example, the method starts with a superellipsoid 
which is then subdivided to generate uniform triangles 
to be approximated with steiner patches. The uniform 
subdivision is essential to ensure that a single normal 

20 is defined at a vertex which is shared by more than one 
triangle, and thereby allow smooth shading of the 
resulting steiner patch tessellation. However, these 
requirements are unduly restrictive and can lead to 
v modelling inaccuracies and inefficiency. Also, the* ray- 

25 tracing technique' used for- rendering can further increase 
computational requirements-. ■ - 

\ 
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The present invention has been made with the above 
problems in mind. 

According to the present invention there is provided a 
processing apparatus or method for use in rendering an 
image of a three-dimensional object surface in which a 
first model of the surface comprising polygons is 
converted into a second model of the surface again 
comprising polygons via a plurality of surface patches. 

The invention also comprises a processing method or 
apparatus in which a parametric surface patch is defined 
for at least some of the polygons making up a model of, 
a curved surface, and a larger number of smaller polygons 
approximating the surface are then generated using the 
surface patches. The smaller polygons need not lie in 
the same plane as an original polygon , and hence can 
better model the curved surface. 

The invention further comprises a processing apparatus 
or method in which polygons modelling at least part of 
a curved surface in three-dimensions are processed to 
define a respective curved surface patch for each 
polygon, and processing is then performed to replace each 
original polygon with different polygons having vertices 
dependent upon the corresponding surface patch. 
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Embodiments of the invention enable conventional 
polygonal models, which are widely used in many 3D 
computer graphics applications, to be replaced with more 
accurate polygonal models. The replacement models can 
then be rendered by evaluating conventional ambient, 
diffuse and/or specular lighting equations, and need not 
be ray- traced . 

Embodiments of the invention will now be described, by 
way of example only, with reference to the accompanying 
drawings, in which like reference numbers designate the 
same or similar things. In the drawings: 

Figure 1 is a block diagram showing the functional 
components of an embodiment; 

Figure 2 shows the overall' processing operations 
performed in the embodiment; 

Figure 3 shows the processing operations performed at 
step S4 in Figure 2; 

Figure 4 shows the processing operations performed at 
step S6 in Figure 2; 

Figure 5 shows the processing operations performed at 
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step S110 in Figure 4; 

Figures 6A, 6B, 6C and 6D show examples of triangles 
sharing an edge, which illustrate the operations 
5 performed in Figure 5; 

Figure 7 shows the processing operations performed at 
step S112 in Figure 4; 

10 Figures 8A, 8B, 8C and 8D show examples of triangles 
amended in dependence upon the flags set after steps S110 
and SI 12 have been performed; 

Figure 9 shows the processing operations performed at 
15 step S8 in Figure 2; 

Figure 10 shows the control points and their barycentric 
coordinates for a triangle for use in defining a cubic 
Bernstein-Bezier triangular patch for the triangle; 

20 

Figure 11 shows the processing operations performed at 
step S234 in Figure 9; 

Figure 12 schematically illustrates the distance 
25 calculated at step S262 in Figure 11; 
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Figure 13 shows the processing operations performed at 
step S262 in Figure 11; 

Figures 14A, 14B, 14C and 14D show examples of triangles 
5 and cubic Bernstein-Bezier triangular patches defined for 
the triangles in dependence upon the edge flags set for 
the triangles; 

Figure 15 shows the processing operations performed at 
10 step S16 in Figure 2; 

Figure 16 shows the processing operations performed at 
step S306 in Figure 15; 

15 Figures 17A and 17B show the look-up tables used at steps 
S346 and S350 in Figure 16, respectively; 

Figure 18 shows the processing operations performed at 
step S316 in Figure 15; 

20 

Figures 19A, 19B and 19C show examples of triangles 
divided for tessellation to depth 2 f depth 3 and depth 
4, respectively; 

25 Figure 20 illustrates how the position of a new" vertex 
is calculated at step S368 in Figure 18; 
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Figures 21A, 21B, 21C and 21D show examples of triangles 
refined into smaller triangles by the operations 
performed at step S316 in Figure 15; 

5 Figure 22 shows the processing operations performed at 
step S318 in Figure 15; 

Figures 23A and 23B illustrate the operations performed 
at step S396 in Figure 22; 

10 

Figure 24 shows the processing operations performed at 
step S398 in Figure 22; 

Figure 25 shows the control points for a triangle 
15 tessellated to depth 4 and the barycentric coordinates 
for each control point; 

Figures 26A, 26B and 26C illustrate the processing 
operations performed at step S406 in Figure 22; 

20 

Figure 27 shows the processing operations performed at 
step S18 in Figure 2; 

Figure 2 8 shows the processing operations performed at 
25 step S474 in Figure 27; 
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Figures 29A and 29B illustrate the processing operations 
performed at step S506 in Figure 28; 

Figure 30 shows the processing operations performed at 
5 step S510 in Figure 28; and 

Figure 31 shows the processing operations performed at 
step S476 in Figure 27. 

10 Referring to Figure 1, there is shown a block diagram of 
the functional components of a 3D graphics processing 
apparatus in an embodiment . 

In the apparatus , there is provided a programmable 
15 computer 2, which comprises a central processing unit 
(CPU) 4 connected to a memory 6 operable to store a 
program defining the operations to be performed by the 
CPU 4, data to be processed by CPU 4 and data processed 
by CPU 4 . 

20 

Coupled to the memory 6 is a disk drive 8 which is 
operable to accept removable data storage media , such as 
a disk 10, and to transfer data stored thereon to the 
memory 6 . 

25 ' - - : ~ ^ v ■ - '-' 

Coupled to an input port of CPU 4 f there is a 'user 
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instruction input device 14, which may comprise, for 
example, a keyboard and/or a position-sensitive input 
device such as a mouse, trackerball etc. 

5 Also coupled to the CPU 4 is a frame buffer 16, which 
comprises a memory unit arranged in a conventional manner 
to store image data relating to at least one image 
generated by the CPU 4. One (or several) memory 
location(s) are provided for a pixel of the image, and 
10 the value stored in the frame buffer for each pixel 
defines the colour or intensity of that pixel in the 
image . 

Coupled to the frame buffer 16 is a display unit 18 for 
15 displaying images using the image data stored in the 
frame buffer 16 in a conventional manner. Also coupled 
to the frame buffer 16 is a video tape recorder (VTR) 20 
or other image data recording device. 

20 A mass storage device 22, such as a hard disk drive, 
having a high data storage capacity, is coupled to the 
memory 6 (typically via the CPU 4), and also to the frame 
buffer 16. The mass storage device 22 can receive data 
processed by the CPU 4 from the memory 6 or data from the 

25 frame buffer 16 which is to be displayed on display unit 
18. 
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Operating instructions for causing the computer 2 to 
perform as an embodiment to the invention can be supplied 
commercially in the form of programs stored on a disk 10 
or another data storage medium (and input into computer 
5 via disk drive 8), can be transmitted as a signal to 
computer 2, for example over a datalink (not shown) such 
as the Internet, or can be entered by a user via input 
device 14, so that the receiving computer 2 becomes 
reconfigured into an apparatus embodying the invention. 

10 

Data to be processed by the CPU 4 may be input to the 
computer 2 from a removable data storage medium using the 
disk drive 8. Alternatively, or in addition, data to be 
processed may be downloaded into memory 6 via a 

15 connection (not shown) from a local or remote database 
which stores the data. In addition, data to be processed 
may be transmitted to computer 2 , for example as a 
broadcast signal. Thus, computer 2 may take the form of 
a "set-top box", that is the apparatus may be configured 

20 to be used with a television 18, to receive broadcast 
data, to process the data and to display processed images 
on the television 18. 

Figure 2 shows the processing operations performed in 
25 this embodiment by the apparatus of Figure 1. 
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Referring to Figure 2, the process starts at step S2 with 
three-dimensional modelling data defining one or more 
objects, each in a three-dimensional object space. This 
data comprises a polygonal mesh model of each object, 
5 which comprises the position of each polygon vertex 
making up the model in the 3D object space and 
connectivity information that can be considered to be 
lines connecting the vertices. The lines are the 
boundaries of the polygons in the model. The 3D 
10 modelling data also comprises information that defines 
the lighting characteristics of each polygon (that is, 
the ambient, diffuse and specular reflection coefficients 
of the polygon) . 

15 The 3D modelling data at step S2 may be input to computer 
2 on a storage medium, such as disk 10, via disk drive 
8, may be transmitted to computer 2 via a communication 
network such as the Internet, for example from another 
computer or a database, or may be received by computer 

20 2 as a signal, for example a broadcast signal. 
Alternatively, the 3D modelling data may be generated in 
computer 2 using a commercially available modelling 
package and instruction from a user via user input device 
14. 

25 

At step S4, CPU 4 determines whether the 3D modelling 
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data received at step S2 is in the required format, and, 
if it is not, converts the data to the necessary format. 

Figure 3 shows the processing operations performed by CPU 
5 4 at step S4 . 

Referring to Figure 3, at step S50, CPU 4 considers the 
3D modelling data defining the model of the next object 
(this being the first object the first time this step is 
10 performed) . 

At step S52, CPU 4 determines whether the model comprises 
triangular polygons. If it is determined at step S52 
that the model of the object being considered does not 
15 comprise triangular polygons, then, at step S54, CPU 4 
converts each polygon to triangles by connecting the 
vertices of each polygon to form triangles in a 
conventional manner. 

20 Following the conversion to triangles at step S54, or, 
if it is determined at step S52 that the model is already 
made up of triangular polygons, at step S56, CPU 4 
determines whether the model of the object being 
considered defines a normal for each vertex of each 

25 triangular polygon. 
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If it is determined at step S56 that the model does not 
define a normal for each vertex, then at step S58, CPU 
4 calculates a normal for each vertex of each triangular 
polygon in a conventional manner, for example using the 
technique described in "Procedural Elements for Computer 
Graphics", by David F. Rogers, McGraw-Hill, 1988, ISBN 
0-07-Y66503-6, pages 317-319 (section 5-3 and example 5- 
2). 

Following the calculation of the unit normals at step 
S58, or, if it is determined at step S56 that the 3D 
modelling data already defines a normal at each vertex 
of each triangular polygon, at step S60, CPU 4 determines: 
whether there is another object model to be considered. 
Steps S50 to S6 0 are repeated to process each model of 
each object in the manner described above, until it is 
determined at step S60 that there are no further models 
to process. 

Referring again to Figure 2, at step S6, CPU 4 constructs 
and stores a topology database for each model of each 
object. As will be explained below, this database stores 
information about each triangle in each model, 
particularly about the edges and vertices of each 
triangle, for subsequent use during rendering . 
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Figure 4 shows the processing operations performed by CPU 
4 at step S6. 

Referring to Figure 4, at step S80, CPU 4 considers the 
5 next triangle in the model of the next object (this being 
the model of the first object the first time step S80 is 
performed ) . 

At step S82, CPU 4 assigns a unique ID to the triangle 
10 and, at step S84, assigns an index to each edge in the 
triangle . 

At step S86, CPU 4 determines whether there is another 
triangle in the model. Steps S80 to S86 are repeated to 
15 process each triangle in the manner described above, 
until it is determined at step S86 that there are no 
further triangles in the model . 

At step S88, CPU 4 assigns a unique numerical ID to each 
20 unique vertex in the model. (A vertex may form part of 
a plurality of triangles, but in this case, at step S88, 
only a single ID is assigned to the vertex.) The IDs are 
assigned at step S88 in numerical order as each unique 
vertex is considered. In this embodiment, the user can 
25 define an uncertainty measure to be associated with the 
position of each vertex in the model so that vertices are 
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treated as the same vertex provided their coordinates do 
not differ by more than the user defined amount. For 
example, the user may define an uncertainty region of 
0.02 for each coordinate, so that the vertex (1.00, 0.00, 
5 0.00) is treated as the same vertex as (0.98, 0.00, 
0.00) . 

At step S90, CPU 4 considers the next triangle in the 
model of the object currently being considered, and, at 
10 step S9 2, considers the next edge in the triangle (this 
being the first edge the first time step S92 is 
performed) . 

At step S93, CPU 4 calculates the dot-product of the 
15 normal vector at the vertex at each end of the edge. The 
calculated value represents the angle between these two 
normal vectors, and hence the curvature of the underlying 
object surface which the triangle represents. The dot 
product value ranges from +1 when the normal vectors are 
20 parallel, indicating no curvature of the edge between the 
vertices, to -1 when the normal vectors point in opposite 
directions (that is, the angle between them is 180°), 
indicating maximum curvature of the edge. 

25 At step S94,. CPU 4 creates a two-dimensional data 
structure from the unique IDs which define the vertices 
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of the edge considered at step S9 2 (these IDs having 
being assigned at step S88). In this embodiment , the 
two-dimensional data structure has the form (IDO, ID1), 
where IDO is the smaller of the two IDs and ID1 is the 
5 bigger of the two IDs. By constructing the two- 
dimensional data structure such that the smallest ID of 
each pair occurs first and the largest ID second, this 
ensures that the edge connecting say vertex M to the 
vertex N is considered to be the same as the edge 
10 connecting vertex N to vertex M. 

At step S96, CPU 4 assigns an ID to the edge in 
dependence upon the two-dimensional data structure formed 
at step S94. CPU 4 assigns the ID at step S96 such that 
15 each unique edge receives a unique ID (an edge which is 
an edge for more than one triangle receives a single , 
unique ID) . 

At step S98, CPU 4 determines whether there is another 
20 edge in the triangle being considered. Steps S9 2 to S9 8 
are repeated to process each edge in the manner described 
above, until it is determined at step S9 8 that there are 
no further edges in the triangle to be processed. 

25 At step S99, - CPU. 4 reads ' the dot-product values 
*-> previously calculated for each pair of normals at step 
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S93 and determines and stores the minimum dot-product 
value for subsequent use, as will be described later. 
The minimum dot-product value is representative of the 
maximum amount of curvature of the portion of the object 
5 surface which the triangle as a whole represents . 

At step S100, CPU 4 determines whether there is another 
triangle to be processed in the model of the object being 
considered. Steps S90 to S100 are repeated to process 
10 each triangle in the manner described above, until it is 
determined at step S100 that there are no further 
triangles to be processed. 

At step S102, CPU 4 considers the next unique edge in the 
15 model of the object being considered (each unique edge 
being identified by the unique ID previously assigned at 
step S96 ) . 

At step S104, CPU 4 determines the number of triangles 
20 in the model of the object which share the edge, and 
reserves memory space for each triangle for storing edge 
flags for the edge. 

At step S106, CPU 4 determines whether there is another 
25 unique edge in the model of the object being considered. 
Steps SI 02 to SI 06 are repeated to process each unique 
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edge in the manner described above, until it * is 
determined at step S106 that all of the edges have been 
processed. 

5 At step S108, CPU 4 calculates a normalised normal (that 
is, a vector perpendicular to the plane of the triangle) 
for each triangle in the model in a conventional manner. 

At step S110, CPU 4 sets edge flags for the edges in the 
10 model of the object being considered. 

Figure 5 shows the processing operations performed by 
CPU 4 to set the edge flags at step S110. 

15 Referring to Figure 5, at step S130, CPU 4 considers the 
next edge in the model of the object currently being 
considered . 

At step S132, CPU 4 determines the number of triangles 
20 sharing the edge, and, at step S134, determines whether 
the edge is part of only one triangle. 

If it is determined at step S134, that the edge is part 
of only one triangle, then*, - at' step S136, CPU 4 sets a 
25 ^border_edge n flag- for the edge. As will be described 
> later, when the border_J_edge flag is set for an edge, that 
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edge is not changed in any subsequent refinement of the 
model of the object (since the model may be required to 
connect with another model along this edge for example). 

5 On the other hand, if it is determined at step S134 that 
the edge is not part of only one triangle, then, at step 
SI 38, CPU 4 determines whether the edge is shared by more 
than two triangles . 

10 Figure 6A illustrates an example situation in which an 
edge is shared by more than two triangles. Referring to 
Figure 6A, edge 30 is shared by triangles 32, 34 and 36. 

If it is determined at step S138 that the edge is shared 
15 by more than two triangles, then, at step S14 0, CPU 4 
sets an "invalid_edge_sharing" flag for the edge for each 
triangle sharing the edge. Referring again to the 
example shown in Figure 6A, the invalid_edge_sharing flag 
would be set for edge 30 for triangle 32, triangle 34 and 
20 triangle 36. As will be described later, if the 
invalid_edge_sharing flag is set for an edge, that edge 
will not be changed during any refinement of the model 
of the object (since it generally indicates an error in 
the topology of the model). In practice, the 

25 invalid_edge_sharing flag is not set very often since 
models of objects are normally created so that any edge 
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sharing takes place between only two triangles . 

On the other hand, if it is determined at step SI 38 that 
the edge is not shared by more than two triangles, then 
the edge must be shared by two, and only two, triangles 
(this is because it was determined at step S134 that the 
edge is not part of only one triangle and it was 
determined at step S138 that the edge is not shared by 
more than two triangles ) . 

Figure 6B shows, by way of example, two views of a 
situation in which an edge is shared by two triangles. 
In the example of Figure 6B, edge 30 is shared by 
triangles 32 and 38. 

When it is determined at step S138 that the edge is not 
shared by more than two triangles, then, at step S142, 
CPU 4 considers the first triangle sharing the edge, and 
at step S144, determines whether the normal at each 
vertex defining the ends of the edge for the first 
triangle are parallel to the triangle normal. 

Figure 6C shows an example in which each vertex normal 
of an edge is parallel to the triangle normal. Referring 
to Figure 6C, in the example shown, the normal 4 2 at the 
- vertex defining one end of edge 30 is parallel to the 
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normal 44 of the vertex defining the other end of the 
edge, and both normals are parallel to the triangle 
normal 46 . 

5 If it is determined at step S144 that the normal at each 
vertex defining the ends of the edge are parallel to the 
triangle normal, then, at step S146, CPU 4 sets a 
"keep_edge M flag for the edge for the first triangle. 
The effect of this flag will be described later. On the 
10 other hand, if it is determined at step S144 that the 
normal at each vertex and the triangle normal are not 
parallel, then step S146 is omitted, such that the 
keep_edge flag is not set for the triangle. 

15 At steps S148, S150 and S152, CPU 4 performs the same 
processing operations on the second triangle sharing the 
edge that was previously performed at steps S142, S144 
and S146 for the first triangle. As these processing 
operations have already been described, they will not be 

2 0 described again here. 

At step S154, CPU 4 determines whether the normal at the 
vertex at the first end of the edge is different for the 
two sharing triangles . 

25 



Figure 6D shows an example in which the normals at a 
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vertex defining the end- of an edge are different for the 
two sharing- triangles . Referring to the example shown 
in Figure 6D, the normal 50 for triangle 32 is different 
to the normal 52 of the triangle 38 at the vertex 54. 

5 

If it is determined at step S154 that the normals at the 
vertex are different for the sharing triangles , then 
processing proceeds -to step S158, at which CPU 4 sets an 
"edge_normals_ambiguous " flag for the edge for both the 
10 sharing triangles. Thus, with reference to the example 
shown in Figure 6D, the edge_normals_ambiguous flag would 
be set for edge 30 for both triangle 32 and triangle 38. 

On the other hand, if it is determined at step S154 that 
15 the normals at the vertex at the first end of the edge 
are the same for the sharing triangles, then processing 
proceeds to step S156. At step S156, CPU 4 determines 
whether the normals at the vertex at the other end of the 
edge are different for the sharing triangles. Referring 
20 again to the example in Figure 6D, the normal 56 for 
triangle 32 is different to the normal 58 for triangle 
38 at the vertex 60. 

If -it- is determined at step S156 that the normals at the 
25 * „vertexv at the second, end -of .the edge are different for 
*■ .the two-sharing triangles, then, at "step S158, CPU 4 sets 
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an "edge_normals_ambiguous " flag for the edge for both 
the sharing triangles- Thus, with reference to the 
example shown in Figure 6D, the edge_normals_ambiguous 
flag would be set for edge 30 for both triangle 32 and 
5 triangle 38. On the other hand, if it is determined at 
step S156 that the normals at the vertex defining the 
second end of the edge are not different for the sharing 
triangles, then step S158 is omitted so that the 
edge_normals_ambiguous flag is not set for the edge. 

10 

Accordingly, as a result of the processing performed at 
steps S154, S156 and S158, the edge_normals__ambiguous 
flag is set for both the triangles sharing an edge if the 
normals at the vertex at either end of the edge are 
15 different for the sharing triangles. 

At step S160, CPU 4 determines whether there is another 
edge in the model which has not yet been considered. 
Steps S130 to S160 are repeated to process all of the 
2 0 edges in the model in the manner described above. 

Referring again to Figure 4, at step S112, CPU 4 amends 
the edge flags previously set at step S110. The purpose 
of the processing performed at step S112 is to identify 
25 edges for which the edge_ normals_ambiguous flag is set 
(indicating that the normal for each sharing triangle is 
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different at at least one vertex defining the ends of the 
edge) and also the keep_edge flag is set for one triangle 
of the pair which shares the edge (indicating that, for 
this triangle, the normal at each vertex is parallel to 
the triangle normal), and to set flags to indicate this 
for subsequent use during rendering. 

Figure 7 shows the processing operation performed by CPU 
4 at step S112 to amend the edge flags. 

Referring to Figure 7, at step S190, CPU 4 considers the 
next edge which is shared by two triangles in the model 
currently being considered. 

At step S19 2, CPU 4 determines whether the 
edge_normals_ambiguous flag is set for the triangles 
which share the edge. If it is determined that the 
edge_normals_ambiguous flag is set, then, at step S194, 
CPU 4 determines whether the keep_edge flag is set for 
the edge for the first but not the second triangle 
sharing the edge . - 

As will be explained in more detail later, if the 
keep_edge flag is set for the first triangle but is not 
set for - the second triangle, "this* corresponds* to a 
situation in which the edge will be changed for the 
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second triangle during refinement of the model of the 
object during rendering, but will not be changed for the 
first triangle. An example of this situation is shown 
in Figure 8A. 

5 

Referring to Figure 8A, edge 30 is not refined for 
triangle 32. However, the edge will be refined for 
triangle 38 so that it approximates the curve 70. 

10 Referring again to Figure 7, at step S196, CPU 4 deletes 
the edge_normals_ambiguous flag for the edge for the 
first and second triangles sharing the edge. At step 
S198, CPU 4 deletes the keep_edge flag for the edge for 
the first triangle sharing the edge. At step S200, CPU 

15 4 sets an " is_attached_edge" flag for the edge for the 
first triangle sharing the edge, and, at step S202, sets 
an "has_attached_edge" flag for the edge for the second 
triangle sharing the edge. 

20 On the other hand, if it is determined at step S194 that 
the keep__edge_f lag is not set for the edge for the first 
but not the second triangle sharing the edge, then 
processing proceeds to step S204, at which CPU 4 
determines whether the keep_edge flag is set for the edge 

25 for the second, but not the first triangle sharing the 
edge. If it is determined at step S204 that the 
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keep_edge flag is set for the second but not the first 
triangle, then the situation occurs in which the edge 
will be modified for the first triangle, but will not be 
modified for the second triangle during subsequent 
5 refinement of the model of the object during rendering. 
An example of this situation is shown in Figure 8B. 

Referring to the example shown in Figure 8B, edge 30 will 
be modified to approximate the curve 7 2 of the triangle 
10 32, but will not be modified for triangle 38. 

At step S206, CPU 4 deletes the edge_normals_ambiguous 
flag for the edge for both the triangles which share the 
edge, and, at step S208, CPU 4 deletes the keep_edge flag 
15 for the* second triangle sharing the edge. 

At step S210, CPU 4 sets an "is_attached_edge" f lag for 
the edge for the second triangle, and at step S212, CPU 
4 sets an "has_attached_edge " flag for the edge for the 
20 first triangle. 

As a result of the processing operations performed in 
steps S192 to S212, CPU 4 has set flags to identify cases 
in which an edge shared by two triangles is to be refined 
25 for one triangle*,' but not" the other triangle. The 
- is_attached_edge flag indicates that the edge will not 
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be changed for the triangle for which this flag is set, 
while the has_attached_edge indicates that the edge will 
be changed for the triangle for which this flag is set. 

5 If it is determined at step S204 that the keep_edge flag 
is not set for the edge for the first but not the second 
triangle, then the flags which are set for the edge for 
each triangle must be the edge_normals_ambiguous flag 
together with the keep_edge flag or ;the 
10 edge_normals_ambiguous flag alone. 

As will be explained in more detail later, if both the 
edge_normals_ambiguous flag and the keep__edge flag are 
set for each edge, then the edge will not be changed for 
15 either of the two triangles when the model of the object 
is refined during rendering. An example of this 
situation is shown in Figure 8C, in which edge 30 is 
refined for neither triangle 32 nor triangle 38. 

2 0 If the edge_normals_ambiguous flag alone is set for the 
edge for both triangles, then the edge will be changed 
for both triangles during subsequent refinement of the 
model. An example of this situation is shown in Figure 
8D, in which the edge previously shared by triangle .32 

25 and triangle 38 is refined to approximate curve 76 for 
triangle 32 and to approximate the curve 78 for triangle 
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38. 

Referring again to Figure 7, at step S214, CPU 4 
determines whether there is another edge in the model 
5 which is shared by two, and only two, triangles. Steps 
S190 to S214 are repeated until all the edges shared by 
two triangles in the model have been processed iri the 
manner described above. 

10 Referring again to Figure 4, at step SI 14, CPU 4 
determines whether there is a model of another object 
which has not yet been processed. Steps S80 to S114 are 
repeated until the model of each object has been 
processed in the manner described above. 

15 

Referring again to Figure 2, at step S8, CPU 4 calculates 
parameters for the refinement of the model of each 
object. 

20 In this embodiment, parameters are calculated to refine 
the model on the basis of cubic Bernstein-Bezier 
triangular patches . 

'Figure 9 shows the processing operations performed by 
25 <CPU*4 at step S8 to calculate* the ' refinement parameters . 
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Referring to Figure 9, at step S230, CPU 4 considers the 
model of the next object, and, at step S232, considers 
the next triangle in the model. At steps S234 and S236, 
CPU 4 calculates "ordinates" for each "control point" of 
5 the triangle being considered. These ordinates define 
a cubic Bernstein-Bezier triangular patch for the 
triangle. 

Figure 10 shows the control points 90, 92, 94, 96, 98, 
10 100, 102, 104, 106, 108 for an example triangle. The 
coordinates shown in brackets for each control point in 
Figure 10 are the barycentric coordinates of the control 
point. In a conventional manner, ten control points are 
used to calculate the ordinates which define a cubic 
15 Bernstein-Bezier triangular patch. Control points 90, 
96 and 102 are located at the triangle vertices. Two 
control points are located at equally spaced positions 
along each triangle edge (these control points being 92, 
94, 98, 100, 104 and 106 in Figure 10). A further 
20 control point is located at the barycentric centre of the 
triangle (this being control point 108 in Figure 10). 

Referring again to Figure 9, at step S234, CPU 4 
calculates an ordinate for each vertex control point (90, 
25 96 and .102 in Figure 10) and each edge control point (92, 
94, 98, 100, 104 and 106 in Figure 10). 
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Figure 11 shows the processing operations performed by 
CPU 4 to calculate the ordinates at step S234. 

Referring to Figure 11, at step S250, CPU 4 sets the 
ordinate for each vertex control point to zero. This 
ensures that the cubic Bernstein-Bezier triangular patch 
defined by the ordinates passes through each vertex of 
the triangle. This ensures that the patch for each 
triangle which shares a given vertex will meet at the 
vertex, thereby ensuring continuity of the triangular 
meshing at the vertices . 

At steps S252 to S264, CPU 4 calculates the ordinate at 
each edge control point (92, 94, 98, 100, 104 and 106 in 
the example of Figure 10). 

More particularly, at step S252, CPU 4 determines whether 
the border_edge flag is set for any edge in the triangle. 
If this flag is set, then, at step S254, CPU 4 sets a 
value of zero for the ordinates for all edge control 
points along each edge for which the border_edge flag is 
set. This ensures that the cubic Bernstein-Bezier 
triangular patch for the triangle will meet each edge in 
the triangle for which the border_edge flag is set. As 
will be described later, this prevents such an edge from 
being changed when the model of the object is irefined 
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during subsequent processing. If the border__edge flag 
is not set for any edge in the triangle, then step S254 
is omitted. 

5 At step S256, CPU 4 determines whether the 
invalid_edge__sharing flag is set for any edge in the 
triangle. If this flag is set for any edge, then at step 
S258, CPU 4 sets a value of zero for the ordinate for 
each edge control point along each edge for which the 

10 invalid_edge_sharing flag is set. The processing at step 
S258 ensures that the Bernstein-Bezier triangular patch 
of a triangle will meet each triangle edge for which the 
invalid_edge_sharing flag is set, thereby preventing 
modification of this edge when the model of the object 

15 is refined during subsequent processing (as will be 
described later). If the invalid_edge_sharing flag is 
not set for any edge in the triangle, then step S258 is 
omitted . 



At step S260, CPU 4 considers the next remaining edge 
control point for. which a value of the ordinate has not 
been set in step S254 or step S258. 

At step S26 2, CPU 4 calculates the value of the ordinate 
for the control point by calculating the distance from 
the control point of the , tangent plane which passes 
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through the nearest vertex, with the distance being 
measured in a direction parallel to the normal of the 
nearest vertex. 

Figure 12 illustrates the distance calculated by CPU 4 
at step S26 2. Referring to Figure 12 , the nearest 
triangle vertex to control point 98 is vertex 96. The 
tangent plane 120 which passes through vertex 96 is the 
plane which is perpendicular to the normal 122 at the 
vertex 96. The distance calculated by CPU 4 at step S262 
is the height M h" from the control point 98 to the plane 
120 in the direction 124 which is parallel to the vertex 
normal 122 . 

Figure 13 shows the processing operations performed by 
CPU 4 at step S262 to calculate the value of the 
ordinate. 

Referring to Figure 13, at step S280, CPU 4 calculates 
the edge direction vector of the edge on which the 
control point lies in the direction from the nearest 
vertex to the control point. 

At . step S282, CPU 4 reads the value of the unit normal 
vector at the closest vertex to the- control point, and, 
at step S284, calculates the scalar product of the edge 
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vector calculated at step S280 and the unit normal vector 
read at step S282. 

At step S286, CPU 4 multiplies the scalar product 
5 obtained at step S284 by minus one third, with the 
resultant value defining the value for the ordinate (this 
being the height "h" shown in the example of Figure 12). 

It will be appreciated that the value of the ordinate 
10 calculated by CPU 4 may be either negative or positive 
depending on the diriection of the normal at the nearest 
vertex to the control point. 

Referring again to Figure 11, at step S264, CPU 4 
15 determines whether there is another edge control point 
for which the ordinate has not been calculated. Steps 
S260 to S264 are repeated until an ordinate has been 
calculated for each edge control point for which the 
ordinate value has not been previously set to zero at 
20 step S254 or step S258. 

Referring again to Figure 9, at step S236, CPU 4 
calculates a value for the ordinate of the centre control 
point (that is, the control point at the barycentric 
25 centre of the triangle - point 108. 4 in the example of 
Figure 10).. In this embodiment, CPU 4 calculates the 
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ordinate for the centre control point as one quarter of 
the sum of the ordinates of the edge control points (92, 
94, 98, 100, 104 and 106 in Figure 10). 

At step S238, CPU 4 determines whether there is another 
triangle in the model for which ordinates have not been 
calculated. Steps S232 to S238 are repeated until 
ordinates have been calculated for each triangle in the 
model . 

At step S240, CPU 4 determines whether there is a model 
of another object to be considered. Steps S230 to S240 
are repeated until ordinates have been calculated for 
each triangle in each model. 

As noted above, the ordinates calculated at step S8 
(Figure 2) define a cubic Bernstein-Bezier triangular 
patch for each triangle in a model. Mathematically, a 
Bernstein-Bezier triangular patch of degree "n" , b n (x), 
is given by the following equation: 

where : 

X is the triplet ( k lr X z , X 3 ) of barycentric 
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coordinates which identifies the position of a 
control point X; 

b A is the value of the ordinate for the control 
point X; and 

B x n (r) is the Bernstein polynomial for control point 
X and is given by: 



where (x lr x 2/ x 3 ) define the barycentric coordinates of 
a point on the original triangle. 

In equations (1) and (2) b n (x) represents the height of 



nl 




(2) 



X X \X 2 \X 2 \ 



the patch above the point r on the triangle, 
following restriction applies to r: 



The 



. . . . (3) 



X is related to x by the following equation: 



•(4) 
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For a cubic Bernstein-Bezier triangular patch', "n" is 3, 
and accordingly the equation of the patch is given by: 



.... (5) 



|A|-3.for all of - the control points 90, 92, 94, 96, 98, 
100, 102, 104, 106 and 108 shown in Figure 10. 
Accordingly, the equation for a cubic Bernstein-Bezier 
triangular patch can be written as follows: 

b 2 (T) = ^ K 3 ! k.k 2 X 3 

=^003^3 + b 030 xl + b 300 xl + 3b 102 T 1 xl + 3b 2Q1 xlx 3 + 32> 012 tIt 2 
+32> 02l tiT 3 + 3b 120 x x xl + 3b 210 xlx 2 + 6 J b 111 x 1 T 2 T 3 

(6) 

in equation 6, b 003 , b 030 , b 300 , b 102 , b 201 , b 012 , b 021 , b 120 , 
b 210 , and b ni are the values of the ordinates calculated 
at step S8 for the control points having barycentric 
coordinates (0,0,3), (0, 3, 0 ) , ■< 3,0,0) , (1,0,2), (2,0,1), 
(0,1,2), (0,2,1), (1,2,0), (2,1,0) and (1,1,1) 
respectively. 



Figures 14A, 14B, -14C and 14D illustrate examples of a 
•Bernstein-Bezier triangular patch for a triangle defined 



37 



2583301 



by ordinates calculated at step S8. It should be noted 
that CPU 4 does not draw any patch, but merely stores the 
ordinates defining the patch for each triangle for 
subsequent use, as will be described later. 

Referring to Figure 14A, an example Bernstein-Bezier 
triangular patch 140 is shown for triangle 32. The patch 
14 0 touches the triangle at each vertex, but, in this 
example, does not touch the triangle at any other point. 
Instead, for every point other than the triangle 
vertices, patch 14 0 is at a height above the surface of 
the triangle 32. 

Figure 14B shows a second example of a Bernstein-Bezier 
triangular patch for triangle 32. Referring to 
Figure 14B, patch 144 meets triangle 32 at each vertex 
of the triangle. In addition, patch 144 meets triangle 
32 at each point along edge 30. The patch meets a 
triangle along each point of an edge when the value of 
each ordinate along the edge is zero. This will occur 
when the border_edge flag, invalid_edge_sharing flag or 
keep_edge flag is set for the edge. In a case where the 
border__edge flag is set, the ordinates along the edge are 
set to zero by CPU 4 at step S254 (Figure 11) to force 
the patch to meet the edge. Similarly, when the 
invalid_edge_sharing flag is set. for an edge, CPU 4 sets 
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the ordinates for the edge to zero at step S258, forcing 
the patch to meet the edge. When the keep_edge flag is 
set for an edge, 'then the normal at each vertex defining 
the ends of the edge are parallel to the triangle normal 
(this being the condition under which the keep_edge flag 
is set at steps S144 and S146 or steps S150 and S152 in 
Figure 5). In this case, the value of the ordinate for 
each control point along the edge will be calculated to 
be zero by CPU 4 at step S262 (Figure 11) because the 
tangent plane at the nearest vertex will pass along the 
edge (that is, the height »h" of the tangent plane shown 
in Figure 12 will be zero along the whole of the edge). 

Figure 14C is an example in which Bernstein-Bezier 
triangular patches are shown for two adjacent triangles 
32 and 38, in which the common edge 30 shared by the 
triangles has the is_attached_edge flag set for triangle 
32 and the has_attached_edge flag is set for triangle 38. 
The patch 144 for triangle 32 meets the triangle at each 
point along edge 30. On the other hand, patch 148 for 
triangle 38 does not touch edge 30 other than at the 
triangle vertices. 

Figure- 14D - shows an example of Bernstein-Bezier 
•triangular pa'tehes for two "adjacent triangles ' 32 and 38 
for which the common edge ^O -shared* by the triangles has 
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the edge_normals_ambiguous flag set for the edge for each 
triangle, but not the keep_edge flag set. In this case, 
neither patch 152 for triangle 32 nor patch 148 for 
triangle 38 touches the edge 30 other than at the 
triangle vertices. 

Referring again to Figure 2, at steps S9 to S34, CPU 4 
performs processing to generate a frame of image data by 
rendering the model of each object. Steps S9 to S34 are 
repeated for each frame of image data so that the 
processing in these steps occurs within the time period 
of one frame. Typically, frames are generated at a video 
rate such as 30 frames per second, in which case the 
frame period during which the processing operations of 
steps S9 to S34 are carried out, is l/30th of a second. 

At step S9, CPU 4 determines the positions of the 
objects. That is, CPU 4 determines whether the position 
of any object is to be changed in accordance with 
instructions input during the time the previous frame of 
image data was being generated. 

At step S10, CPU 4 determines the lighting parameters 
which are to be used to light the models of the objects. 
These parameters are conventional, lighting parameters, 
comprising,, for example the amount of ambient light, and 
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the position , direction and intensity values of one or 
more individual light sources. The lighting parameters 
may be defined in the 3D modelling data received at step 
S2. In addition, or instead, they may be input to CPU 
5 4 , or changed, by a user via input device 14. At step 
S10 CPU 4 reads the values of the lighting parameters 
including any changes which have been made thereto during 
the previous frame period. 

10 At step SI 2, CPU 4 reads data defining a viewing position 
and viewing direction from which an image of the objects 
is to be generated. The viewing parameters define a view 
transformation which transforms polygons from a 3D world 
space to a 3D viewing (or camera) space. The viewing 

15 parameters may be input by a user, for example via input 
device 14. At step S12, CPU 4 reads the values of the 
viewing parameters including any changes which have been 
made thereto during the previous frame period. 

20 At step S14, CPU 4 culls objects which do not lie within 
the field of view defined by the viewing parameters 
determined at step S12, so that these objects are not 
processed further, thereby reducing the amount of 
processing which has to be carried out. 

25 :-v\-.\ = ;r i v.:..-. - " ■ • ; - - 

More particularly , in this embodiment, a bounding box is 
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defined for each object in a conventional manner in. the 
object space of the object. The local transformation, 
which transforms points from objects space to a shared 
3D world space, and the viewing transformation, which 
5 transforms points from the 3D world space to the 3D 
viewing space, are then performed as a common operation 
on the bounding box by concatenating the matrices which 
define the local transformation and the viewing 
transformation. This places the object's bounding box 
10 within the viewing space. Thereafter, the position of the 
transformed bounding box is considered, to determine 
whether it is totally within the viewable space, totally 
outside the viewable space or intersecting the viewable 
space. 

15 

If a bounding box is totally outside the viewable space, 
no further processing is performed on the polygons 
defining the object within the bounding box. If a 
bounding box is partially or completely within the 

20 viewable space, then the polygons defining the object 
within the bounding box are processed to generate image 
data. In addition, however, for bounding boxes which are 
partially within the viewable space and partially outside 
the viewable space, data defining the planes of 

25 intersection of the bounding box and the viewable space 
are stored for subsequent use in the clipping of polygons 
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defining the object, as will be described later. 

At step S16, the model of each object which remains after 
culling at step S14 is refined by CPU 4 using the 
5 refinement parameters previously calculated at step S8. 

The purpose of the processing carried out by CPU 4 at 
step S16 is to refine each triangular polygon in the 
model of an object into a larger number of smaller 

0 triangles which more accurately represent the object 
surface. As will be explained below, the smaller 
triangles do not necessarily lie in the same plane as the 
original triangle, and hence the underlying object 
surface can be more faithfully modelled. Therefore, by 

5 performing the processing at step S16, the curvature of 
the object surface can be represented and displayed to 
a viewer more accurately. 

Figure 15 shows the processing operations performed by 
0 CPU 4 to carry out refinement at step SI 6 in this 
embodiment . 



Referring to Figure 15, at step S298, CPU 4 determines 
whether the processing : being carried out is 4 being 
performed to generate the 1 first frame'- of image data . If 
it is determined that the processing is to generate the 
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first frame, then no refinement of any model is 
performed, so that each model is processed in unrefined 
form for the first frame. 

5 On the other hand, if the processing is for a second or 
a subsequent frame of image data, then, at step S300, CPU 
4 considers the model of the next object to be processed 
(this being the first object the first time step S300 is 
performed). At step S302, CPU 4 considers the next 
10 triangle in the model of the object. 

At step S304, CPU 4 determines whether each edge in the 
triangle has a keep_edge, is__attached_edge, border__edge 
or invalid_edge_sharing flag set. If one of these flags 
15 is not set for every edge in the triangle, then at least 
one edge of the triangle (or more particularly, any edge 
for which one of the flags is not set) will be changed 
since the Bemstein-Bezier triangular patch does not meet 
this triangle edge. 

20 

Accordingly, if it is determined at step S304 that at 
least one edge in the triangle does not have one of these 
flags set, then at step S306, CPU 4 determines the depth 
of tessellation required for this triangle. (Step S306 
25 is omitted if one of these flags is set for every edge 
in the triangle. ) 
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Figure 16 shows the processing operations performed by 
CPU 4 at step S306 to determine the depth of tessellation 
for the triangle. 

5 Referring to Figure 16, at step S34 2 f CPU 4 reads the 
screen coordinates of the three triangle vertices from 
the previous frame of image data displayed to the viewer. 

At step S344, CPU 4 uses the vertex coordinates read at 
10 step S342 to determine the area of the triangle in the 
previous frame. 

In this embodiment, it is assumed that the area of the 
triangle in the image frame for which the current data 

15 is being generated will be approximately the same as the 
area of the triangle in the previous frame since the 
object can not have moved much in one frame period. 
Accordingly, at step S346, CPU 4 uses the triangle area 
determined at step S344 as input to a first look-up 

20 table, and reads the depth value defined in the look-up 
table for this input value. 

Figure 17A shows the information stored in the first 
look-up table in this embodiment. 

Referring to Figure 17A, in this embodiment, the look-up 
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table specifies one of ten different depth values. The 
first depth value, depth 1 indicates that no tessellation 
of the triangle is to take place. As will be described 
later, depths 2 to 9 indicate that tessellation is to 
5 take place, with the number of smaller triangles into 
which the triangle is divided increasing as the. depth 
increases. The depth value increases as the area of the 
triangle in the previous frame increases (which indicates 
that the user will be able to see more detail in the 
10 triangle, and hence a large number of smaller triangles 
is desirable to display the required detail). 

Referring again to Figure 16, at step S348 CPU 4 reads 
from the topological database the minimum value of the 
15 dot-product of vector normals, which was previously 
stored at step S9 9 (Figure 4). As described above, this 
value is indicative of the curvature of the part of the 
object surface which the triangle represents. 

20 At step S350, CPU 4 uses the minimum dot-product value 
read at step S348 as input to a second look-up table, and 
reads the depth value defined in the look-up table for 
this input value. , 

25 Figure 17B shows the information stored in the second 
look-up table in this embodiment . 
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Referring to Figure 17B, it will be seen that the depth 
value increases as the vertex normal dot-product value 
decreases (that is, as the curvature of the object 
surface which the triangle represents increases, such 
5 that a large number of small triangles aire required to 
represent the curvature). As with the first look-up 
table, the output from the second look-up table is one 
of ten different depth values. 

10 At step S352, CPU 4 combines the depth value read from 
the first look-up table in dependence upon the triangle 
area at step S34 6 and the depth value read from the 
second look up table in dependence upon the minimum 
vertex normal dot-product read at step S350. In this 

15 embodiment, the two depth values are added and one is 
subtracted from the total, to give a final depth value 
for tessellation. For example, if the triangle has an 
area of 1000 pixels, then the depth value read from the 
first look-up table at step S346 is 5, and if the minimum 

20 vertex normal dot-product of the triangle is 0.80, then 
the depth value read from the second look-up table at 
step S350 is 2. Accordingly, at step S352, the depth of 
tessellation is determined to be 5+2-1=6. 

25 Referring again to Figure 15, at step S308, CPU 4 
determines whether there is another triangle in the model 
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of the object being considered. Steps S302 to S308 are 
repeated until all of the triangles in the model have 
been processed in the manner described above. 

At step S3 10, CPU 4 determines a depth of tessellation 
for the model as a whole by selecting the greatest depth 
of tessellation which was determined for a triangle 
within the model at step S306. This tessellation will 
then be used for all triangles in the model. 

At step S312, CPU 4 determines whether data defining the 
model tessellated at the depth determined at step S310 
is already stored in memory. This determination is 
carried out because, as will be described later, when a 
model of an object is tessellated to a new depth, data 
defining the tessellation is stored for subsequent use. 

If it is determined at step S312 that data defining the 
required tessellation is stored in memory, then, at step 
S314, the data is read from the memory. On the other 
hand, if it is determined at step S312 that data defining 
the required tessellation is not stored, then, at step 
S316, CPU 4 performs processing to tessellate all of the 
triangles in the model to the depth determined at step 
S310. . 
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Figure 18 shows the processing operation performed at 
step S316 by CPU 4 to carry out the tessellation. 

Referring to Figure 18, at step S360, CPU 4 considers the 
5 next triangle in the model. 

At step S362, CPU 4 calculates the barycentric 
coordinates of the point on the triangle for which the 
next new vertex is to be created (this being the first 
10 new vertex the first time step S362 is performed). 

Figures 19A, 19B and 19C illustrate the points on a 
triangle for which new vertices are created for depths 
2, 3 and 4 in this embodiment (as explained previously 
15 with respect to Figures 17A and 17B, depth 1 indicates 
that no tessellation is to take place) . 

Referring to Figure 19A, when a triangle is to be 
tessellated to depth 2, a new triangle vertex is 

20 calculated for the points 170 f 172 and 174 , each of which 
lies half-way along a respective side of the triangle. 
It should be noted that a new vertex is not actually 
placed at points 17 0, 17 2 and 174, but instead the 
position of a new vertex is calculated for each of the 

25 points* 17 0 , 172 and 174 .in dependence upon the height of 
the Bernstein-Bezier triangular' patch above these points , 
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as will be described below. 

Referring to Figure 19B, when a triangle is to be 
tessellated to depth 3, a new vertex is calculated for 
5 each of the points 176, 178, 180, 182, 184 and 186, which 
divide the respective edges of the triangle into thirds . 
A new vertex is also calculated for the point 188, whose 
position on a triangle is determined by connecting the 
points 176, 178, 180, 182, 184 and 186 as shown in Figure 
10 19B. 

Referring to Figure 19C, when a triangle is to be 
tessellated to depth 4, a new vertex is created for each 
of the points 190, 192, 194, 196, 198, 200, 202, 204 and 

15 206, which are equally spaced along the edges of the 
triangle and divide each respective edge into quarters . 
New vertices are also calculated for the points 280, 210 
and 212 inside the triangle, whose positions are 
determined by connecting the points 190, 192, 194, 196, 

20 198, 200, 202, 204 and 206 as shown in Figure 19C. 

The points for which new vertices are calculated for 
other depth levels are determined in a similar manner. 
The number of new vertices generated along each. edge of 
25 the triangle is equal to. the depth number minus one, and 
the number of new triangles into which the original 
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triangle is divided is equal to the square of the depth 
number. For example, when a triangle is to be 
tessellated to depth 10, new vertices are calculated for 
nine points along each edge of the triangle which divide 
5 the edge into tenths, and for points inside the triangle 
defined by interconnecting the points along the edges. 
The number of triangles generated is then 100. 

It will be appreciated that the barycentric coordinates 
10 of the points in the triangle for which new vertices are 
to be created can be calculated and stored in advance for 
each depth level. In this way, the step of determining 
the barycentric coordinates at step S3 6 2 can be performed 
by reading the required coordinates from memory. 

15 

Referring again to Figure 18, at step S364, CPU 4 uses 
the ordinates previously calculated for the triangle at 
step S8 to calculate the height of the Bernstein-Bezier 
triangular patch above the point on the triangle whose 

20 barycentric coordinates were determined at step S362. 
This is done by evaluating the Bernstein-Bezier patch 
equation using the barycentric. coordinates determined at 
step S362. More particularly, CPU 4 evaluates 

equation 6 above using the barycentric coordinates - (x lf 

25 *t 2/ x 3 ). of the new point and- the values of the ordinates 
koo3/ b 030/ ^3oor k 102 , k 20 i/ ^012* t> 021 , b 120 , b 210 , b lu calculated 



51 



2583301 



at step S8 to give a value for b 3 (x) which is the height 
of the Bernstein-Bezier patch above the point. 

At step S366, CPU 4 calculates the normal at the point 
5 on the triangle whose barycentric coordinates were read 
at step S362. In this embodiment, CPU 4 calculates the 
normal , N new , using the following equation: 

N new = x x m^v 2 H2^T 3 U3 (7) 

where Nl , N2 and N3 are the unit normal vectors at the 
10 vertices of the triangle. More particularly, the vertex 
whose first barycentric coordinate is non-zero is defined 
to have the normal N 1 , the vertex whose second 
barycentric coordinate is non-zero is defined to have the 
normal N2 and the vertex whose third barycentric 
15 coordinate is non-zero is defined to have the normal N3 . 

At step S368, CPU 4 uses the height calculated at step 
S364 and the normal calculated at step S366 to calculate 
the position of the new vertex to be used in 
20 tessellation. More particularly, CPU 4 calculates the 
position of the new vertex as the point which lies a 
distance measured from the point on the original triangle 
whose barycentrics coordinates were read at step S362 
which is equal to' the height calculated at step S364 
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measured in - the direction of the normal calculated at 
step S366 . 

Figure 20 illustrates , by way of example, " the 
calculations at steps S364, S366 and S368. 

Referring to Figure 20, the Bernstein-Bezier patch 144 
is shown for triangle 32/ which was previously described 
with respect to Figure 14B. The height of the Bernstein- 
Bezier triangular patch calculated at step S364 above 
point 170 (which, as described previously with respect 
to Figure 19A, is the mid-point of a side of the 
triangle) is "H" . The vector normal at point 170 is N new . 
The position of the new vertex to be used in tessellation 
is point 220 , which lies along the normal N new by a 
distance " H " from point 170. It will be seen from the 
example shown in Figure 20, that the new point does not 
necessarily lie on the surface of the Bernstein-Bezier 
triangular patch defined by the ordinates previously 
calculated by CPU 4 at step S8 (Figure 2). 

Referring again to Figure 18, at step S37 0, CPU 4 defines 
a vector normal for the new vertex calculated at step 
S3681 In this embodiment, CPU 4 defines the vector 
normal to be the same as the vectoi: normal calculated at 
step S366 . : , . . * : . ■ . - - 
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At step S372 f CPU 4 determines whether .there is another 
vertex on the original triangle for which a new vertex 
to be used in tessellation is to be calculated. Steps 
S362 to S372 are repeated until a new vertex has been 
5 calculated for each required point on the triangle (that 
is, the points on the triangle defined by the depth 
level; for example points 17 0, 17 2 and 174 shown in 
Figure 19A where the depth level is depth 2 and points 
176, 178, 180, 182, 184, 186 and 188 shown in Figure 19B 
10 where the depth level is depth 3). 

At step S374, CPU 4 defines connections between the new 
vertices calculated at step S368. This defines a number 
of tessellated triangles for the original triangle. The 

15 tessellated triangles do not necessarily lie in the plane 
of the original triangle, and hence more accurately 
represent the curvature of the object surface which the 
original triangle represented as being flat. (The 
tessellated triangles will all lie in the same plane as 

20 the original triangle if each edge of the original 
triangle has the keep__edge, is_attached__edge, 
border_edge, or invalid_edge_sharing flag set.) 

Figures 21A, 21B, 21C and 21D illustrate examples of 
25 tessellated triangles when the triangles shown in Figures 
14A, 14B, 14C and 14D are tessellated to depth two.,-. 
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Referring to Figure 21A, new vertices 220, 222 and 224 
are generated and connected . None of the new vertices 
lies along an edge of the original triangle in the plane 
of the original triangle since none of the edges of 
5 triangle 32 has the keep_edge, is__attached_edge , 
border__edge or invalid__edge__sharing flag set. 

Referring to Figure 21B, new vertices 230 , 232 and 234 
are created and connected. New vertex 232 lies mid-way 
10 along edge 30 because edge 30 has the keep_edge, 
is_attached_edge , border_edge or invalid_edge_sharing 
"flag set . 

Referring to Figure 21C, the new vertices 230, 232 and 
15 234 for triangle 32 are the same as those illustrated in 
Figure 21B. However, Figure 21C illustrates an' example 
in which edge 30 which is common to triangle 32 and 
triangle 38 has been modified for triangle 38 since edge 
30 does not have the keep_edge, is__attached__edge, 
20 border_edge or invalid_edge_sharing flag set for 
triangle 38. More particularly, the example illustrated 
in Figure 21C corresponds to a case where edge 30 has the 
is_attached_edge flag set for triangle 32 and has the 
has_attached_edge flag set for triangle 38. Accordingly, 
25 for triangle 38, new vertex 240 is calculated. New 
vertices- -for the other -edges of triangle 38' are not 
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illustrated in Figure 21C. It will be seen from Figure 
21C that a gap 242 (illustrated by the dotted, area) 
between the triangle 32 and the triangle 38 has been 
created along edge 30. The way. in which this edge will 
5 be dealt with will be described later. 

Referring to Figure 21D, new vertices 250 , 252 and 254 
are created for triangle 32, and a new vertex 256 is 
created for side 30 of triangle. 38 (the new vertices 

10 created for the other sides of triangle 38 are not 
illustrated in Figure 21D) . The example shown in Figure 
21D corresponds to the case where the 
edge_normals_ambiguous flag is set for edge 30 of 
triangle 32 and triangle 38 , but the keep_edge flag is 

15 not set for edge 30 for either triangle. As will be seen 
from Figure 21D, a gap 258 (illustrated by the dotted 
area) has been created between the triangle 32 and the 
triangle 38. 

20 Referring again to Figure 18, at step S376, CPU 4 
determines whether there is another triangle to be 
processed in the model.. Steps S360 to S376 are repeated 
until each triangle has been processed to generate 
tessellated triangles in the manner described above. 

25 . . . -.. . .... . -.. 

Referring again to Figure 15,- at step S318, CPU - 4 
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performs processing to correct the topology of the 
tessellated models generated at step S316. More 
particularly, CPU 4 carries out processing to fill any 
gaps in the model created between adjacent triangles , 
5 such as the gap 242 shown in the example of Figure 21C 
and the gap 258 shown in the example of Figure 21D. 

Figure 22 shows the processing operations performed by 
CPU 4 at step S318 to correct the topology. 

10 

Referring to Figure 22, at steps S390 to S400, CPU 4 
performs processing to fill gaps created between 
triangles along an edge for which the is__attached_edge 
flag is set for the edge for one triangle and the 
15 has_attached__edge flag is set for the other triangle. 

More particularly, at step S390, CPU 4 considers the next 
triangle in the model, and at step S392, CPU 4 reads the 
edge flags for the triangle from the topological 
20 database. 

At step S394, CPU 4 determines whether" the 
is_attached_edge * flag - is set for' any edge of the 
triangle. If- this flag is not set, then processing 
25 -proceeds to step S400: ;: On the othfer hand/ if it is 
* ; determined that an- 'is_atta"ched_Jedge f lag is set, then, 
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at step S396, for each edge for which the 
is_attached_edge flag is set, CPU 4 moves the new 
vertices for the edge generated by tessellation at step 
S368 (Figure 18) to meet the corresponding new vertices 
5 for the corresponding edge for which the 
has_attached_edge flag is set. Referring to Figure 21C 
again, by way of example, the is_attached_edge flag is 
set for edge 30 for triangle 32 and the has_attached_edge 
flag is set for edge 30 for triangle 38. Accordingly, 
10 at step S396, CPU 4 moves the position of the new vertex 
232 for the edge 30 generated by tessellation to the 
position of the corresponding new vertex 240 generated 
for edge 30 for triangle 38. 

15 Figure 23A illustrates, by way of further example, a case 
in which triangle 32 and triangle 38 are tessellated to 
depth four. Again, the is_attached_edge flag is set for 
edge 30 for triangle 32 and accordingly the three new 
vertices 270, 27 2, 274 generated by tessellation at step 

20 S368 (Figure 18) lie on the edge 30. The edge 30 has the 
has_attached_edge flag set for triangle 38. Accordingly, 
the new vertices 276, 278, 280 generated by tessellation 
for edge 30 and triangle 38 do not lie along the edge 30. 
At step S396, CPU 4 moves the. position of vertex 270 to 

25 the; position of vertex 276, moves the position of vertex 
272 to the position of vertex 278, and moves the position 
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of vertex 274 to the position of vertex 280. 

Figure 23B shows the resulting tessellation of triangle 
32 from the example of Figure 23A after step S396 has 
been performed. 



Referring to Figure 23B, the result of moving vertices 
270, 272- and 274 is that each of the tessellated 
triangles which includes one of these vertices has its 
shape (and, most probably, the plane in which it lies) 
changed. In the example of Figure 23A, vertices 27 0, 27 2 
and 274 were moved away from the original triangle to 
meet the corresponding refined vertices of triangle 38. 
Therefore, as shown in Figure 23B, triangles 300, 302, 
304, 306, 308, 310 and 312 are larger than the remaining 
tessellated triangles. 

However, it is desirable that the tessellated triangles 
are of approximately even size and evenly distributed 
over the original triangle. In this way, in cases where 
the plane of a triangle is changed by moving the vertex 
for an edge having the is_attached edge flag set, the 
curvature of the underlying object surface is more evenly 
modelled. - '-- - - . . • 

Accordingly-, - referring- again to -Figure 22, at step S398, 
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CPU 4 redistributes the vertices of the tessellated 
triangles which lie inside the original triangle. In the 
example of Figure 23B, these vertices are vertices 320, 
322 and 324. It will be appreciated that the number of 
5 internal vertices to be redistributed in this step is 
dependent upon the depth of tessellation, with the number 
of internal vertices increasing as the depth increases. 
It will also be seen from Figure 19A that there are no 
internal vertices to be redistributed when the depth of 
10 tessellation is depth 2. 

Figure 24 shows the processing operations performed by 
CPU 4 to redistribute the internal vertices at step S398. 

15 Referring to Figure 24, at step S4 20, CPU 4 considers the 
next internal vertex. At step S4 22, CPU 4 determines the 
barycentric coordinates of each of the six edge vertices 
which are connected to the internal vertex currently 
being considered. 

20 

Figure 25 shows triangle 32 from the example shown in 
Figures 23A and 23B divided to depth four. 

Referring to Figure 25, triangle 32 is divided to depth 
25 4, and accordingly there are three internal vertices 320, 
322 and 324 to be redistributed. -The barycentric 
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coordinates of each vertex are shown in Figure 25. 

The six edge vertices to which an internal' vertex is 
connected are the ones reached by travelling from the 
internal vertex in the six directions parallel to the 
triangle edges until an edge vertex is reached. 
Accordingly, vertex 320, which has barycentric 
coordinates (2,1,1), is connected to the six edge 
vertices having barycentric coordinates (3,1,0), (2,2,0), 
(3,0,1), (2,0,2), (0,3,1) and (0,1,3). 

Similarly, internal vertex 322 has barycentric 
coordinates (1,2,1) and is connected to the six edge 
vertices having barycentric coordinates (1,3,0), (2,2,0), 
(3,0,1), (1,0,3), (0,3,1) and (0,2,2). Internal vertex 
324 has barycentric coordinates ( 1 , 1 , 2 ) and is connected 
to the six edge vertices having barycentric coordinates 
(1,3,0), (3,1,0), (2,0,2), (1,0,3), (0,1,3) and (0,2,2). 

When travelling from an internal vertex to an edge, one 
of the barycentric coordinates of the vertices will 
decrease. For example, when travelling from internal 
vertex 324 to edge vertex 270, the third barycentric 
coordinate decreases from 2 at vertex 324 to 1 at vertex 
322 to 0 at vertex : 270*. : In addition, when' travelling 
from an internal vertex to an edge, another of the 
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barycentric coordinates will remain constant. For 
example, when travelling from internal vertex 324 to edge 
vertex 270, the first barycentric coordinate has a 
constant value of 1. 

At step S422 CPU 4 uses the fact that each edge vertex 
which is connected to the internal vertex will have one 
barycentric coordinate which is 0 and a further 
barycentric coordinate which is the same as that of the 
internal vertex to compute the full barycentric 
coordinates of the six connected edge vertices. 

At step S4 24, CPU 4 calculates a weight for each of the 
six edge vertices which are connected to the internal 
vertex. In this embodiment, CPU 4 determines the weight 
for each connected edge vertex on the basis of the 
barycentric coordinates of the internal vertex currently 
being considered and the barycentric coordinate of the 
edge vertex which is 0. More particularly, if the first 
barycentric coordinate of the edge vertex is 0, then 
CPU 4 allocates a weight to this vertex of the reciprocal 
of. the first barycentric coordinate of the internal 
vertex. Similarly, if the second barycentric coordinate 
of the edge vertex is 0, CPU 4 allocates a weight of the 
reciprocal of the second barycentric coordinate of the 
internal vertex,, while if the third barycentric 
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coordinate of the edge vertex is 0, CPU 4 allocates a 
weight of the reciprocal of the third barycentric 
coordinate of the internal vertex. 

Referring again to the example of Figure 25, for internal 
vertex 322, the weight assigned to edge vertex 270 and 
edge vertex 272 (whose third barycentric coordinate is 
0) is 1/1, th4 weight assigned to edge vertices 330 and 
332 (whose first barycentric coordinate is 0) is 1/1, and 
the weight assigned to edge vertices 334 and 336 (whose 
second barycentric coordinate is 0) is 1/2. 

At step S4 26, CPU 4 reads the three-dimensional position 
of each of the six connected edge vertices (that is, the 
positions after vertices have been moved at step S396) 
and combines the positions in accordance with the weights 
calculated at step S424, to give a new position for the 
internal vertex currently being considered. In this 
embodiment, the combination at step S426 is ■ performed 
using the following equation to combined the positions 
in a vector sense : 

vnew = w x v^w 2 v 2 ^v^w,v^w^w e v e . \ ; ( 8 ) 
+ w 2 + w 3 + w 4 + w 5 + w 6 

where: V new is the new three-dimensional position of 
- * the -internal vertex; - 
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W L (i=1..6) is the weight of the ith edge 
vertex calculated at step S4 24 ; 

V £ (i=1..6) is the three-dimensional position 
of the ith edge vertex. 

5 

It will be understood that, in step S426, as well as 
moving the position of the internal vertex parallel to 
the plane of the original triangle, the internal vertex 
may also be moved to a different height above the 
10 original triangle. 

By performing steps S4 20 to S4 2 6 as described above, CPU 
4 repositions the internal vertex in dependence upon the 
six connected edge vertices. Edge vertices which are 
15 closer to the internal vertex have a larger weight than 
edge vertices which are further from the internal vertex, 
and accordingly the position of closer edge vertices 
influence the position of the internal vertex more than 
the positions of edge vertices further away. 

20 

At step S428, CPU 4 determines whether there is another 
internal vertex to be repositioned. Steps S420 to S428 
are repeated until all internal vertices have been 
repositioned in the manner described above. 

25 - - 



Referring again to Figure 22, at step S400, CPU 4 
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determines whether there is another triangle in the model 
which has not yet been considered. Steps S390 to S400 
are repeated until all triangles in the model have been 
processed in the manner described above. 

At steps S402 to S408, CPU 4 performs processing to fill 
gaps created between triangles along ah edge for which 
the edge__normals_ambiguous flag is set for the edges but 
the keep_edge flag is not set for either edge (this 
corresponding to a situation in which the edge has been 
modified for both triangles which share the edge , for 
example as shown in the example of Figure 21D). 

More particularly, at step S402, CPU 4 reads the edge 
flags from the topological database. At step S404, CPU 
4 considers the next pair of edges for which the 
edge_normals_ambiguous flags are set, but for which the 
keep_edge flags are not set. 

At step S406, CPU 4 fills the gap between the two 
modified edges. In this embodiment, CPU 4 performs this 
by connecting the new vertices generated by tessellation 
to form "stitching triangles". 

Figures 26A, 26B and 2 6C show ^examples of how stitching 
-triangles are generated by CPU 4 at step S406. 
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Figure 2 6A shows an example in which the triangles 
sharing an edge are . tessellated to depth 2, In this 
case, the new vertices 350, 352 generated by tessellation 
are connected to form stitching triangles 354 and 356. 

Figure 2 6B shows an example in which the triangles 32 and 
38 are tessellated to depth 3. In this case, vertex 360 
in triangle 32 is connected to the corresponding vertex 
in triangle 38 (that is, the vertex resulting from the 
same original point on edge 30), this being vertex 362. 
Similarly, vertex 364 in triangle 32 is connected to 
corresponding vertex 366 in triangle 38. In addition, 
the quadrilateral formed by vertices 360, 362, 366 and 
364 is divided into triangles by connecting vertex 360 
from triangle 32 with the vertex 366 of triangle 38 at 
the opposite corner of the quadrilateral. 

Figure 26C shows an example in which triangles 32 and 38 
are tessellated to depth 4. In this situation, vertex 
370 of triangle 32 is connected to the corresponding 
vertex 37 2 in triangle 38, vertex 374 in triangle 32 is 
connected to the corresponding vertex 376 in triangle 38, 
and vertex 378 in triangle 32 is connected to the 
corresponding vertex 380 in triangle 38. To divide the 
quadrilateral formed by .connected vertices 370, 372, 376 
and 374, CPU 4 connects, vertex 370 of triangle 32 to 
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vertex 376 in triangle 38 at the opposite corner of the 
quadrilateral. Similarly, to divide the quadrilateral 
formed by connected vertices 374, 376, 380 and 378 into 
triangles, CPU 4 connects vertex 374 of triangle 32 to 
5 vertex 380 of triangle 38 at the opposite corner of the 
quadrilateral. 

Referring again to Figure 22, at step S408, CPU 4 
determines whether there is another pair of edges for 
10 which the edge__normals_ambiguous flags are set but for 
which the keep_edge flags are not set. Steps S4 04 to 
S408 are repeated until each pair of edges for which the 
edge_normals_ambiguous flags but not the keep_edge flags 
are set is processed in the manner described above . 

15 

Referring again to Figure 15, at step S320, CPU 4 stores 
the data generated at steps S316 and S318 in memory for 
subsequent re-use in generating image data for another 
frame when the same depth of tessellation is required. 

20 

At step S32 2, CPU 4 determines whether there is a model 
of another object to be processed. Steps S300 to S322 
are repeated until each model has been processed in the 
manner described above. 
25 — ' - - - • - • - ' " " - 

Referring again to Figure 2, at step SI 8, CPU 4 lights 
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the triangular polygons generated at step S16. 

In this embodiment, the lighting is carried out in. the 
object space of each object* This is effected by 
5 calculating the inverse to the local transform (which 
transforms the object from its object space to the common 
3D world space) and performing the inverse transform upon 
the position of each light source, thereby transforming 
the light sources into object space. 

10 

Figure 27 shows the processing operations performed by 
CPU 4 to light the polygons at step S18. 

Referring to Figure 27, at step S450, CPU 4 considers the 
15 model of the next object. 

At step S452, CPU 4 determines whether the frame of image 
data to be displayed is the first frame. If it is 
determined that the frame is the first frame of image 

20 data, then, at step S454, CPU 4 calculates a value for 
each colour component at each triangle vertex in the 
model in a conventional manner* . In this embodiment, for 
each colour component at each triangle vertex, CPU 4 
calculates an ambient light intensity value, a diffuse 

25 light intensity value and a specular light intensity 
value taking into account all of the light sources 
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present. This is performed in a conventional manner, for 
example as described in "Computer Graphics Principles & 
Practice" by Foley, van Dam, Feiner & Hughes, Addison- 
Wesley Publishing Company, 2nd Edition, ISBN 0-201-12110- 
5 7, sections 16.1 and 16.2. 

On the other hand, if it is determined at step S452 that 
the frame of image data to be displayed is not the first 
frame, then, at step S456, CPU 4 determines whether the 
10 viewing parameters (defining the position and direction 
from which the image is to be viewed) determined at step 
SI 2 have changed since the previous frame/ If it is 
determined that the viewing parameters have changed, then 
processing proceeds to step S462. 

15 

On the other hand, if it is determined at step S456 that 
the viewing parameters have not changed since the 
previous frame, then, at step S458, CPU 4 determines 
whether the lighting parameters (determined at step S10) 
20 have changed since the previous frame. If it is 
determined that the lighting parameters have changed, 
then processing proceeds to step S462. 

- : On the other hand, if it is determined at step S458 that 
25 ~ -the - lighting parameters r have not changed since the 
" " previous - frame/ therr, -at step S460, CPU 4 determines 
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whether the object has moved since the previous frame. 
If it is determined that the. object has not moved, then 
the viewing parameters, lighting parameters and object 
position have not changed since the previous frame. 
Accordingly, CPU 4 uses the lighting values calculated 
for the previous frame for the current frame, and 
processing proceeds to step S482. 

On the other hand, if it is determined at step S456 that 
the viewing parameters have changed, or if it is 
determined at step S458 that the lighting parameters have 
changed, or if it is determined at step S460 that the 
object has moved, then it is necessary to calculate new 
lighting values, and processing proceeds to step S462. 

At step S46 2, CPU 4 determines whether the model is 
tessellated to a depth greater than a predetermined 
depth. In this embodiment, the predetermined depth is 
depth 3 (as illustrated in Figure 19B) . The result of 
this test determines how the lighting values will be 
calculated for the model. More particularly, the 
refinement of a model at step SI 6 generates a number of 
new vertices, and a value for each colour component must 
be calculated at each vertex. Accordingly, the number 
of calculations, to be performed .increases as the number 
of vertices increases . .In this embodiment , rather. than 
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calculate the value for each colour component at each 
vertex in the conventional manner described above, a 
different technique referred to as a "lighting patch" 
technique may be used which is computationally more 
5 efficient . The lighting patch technique is more 
efficient than the conventional technique when the number 
of vertices for which lighting values are to be 
calculated exceeds a predetermined value. On the basis 
of the lighting patch technique used in this embodiment, 
10 the predetermined value of the number of vertices is 
reached when a triangle is tessellated to a depth greater 
than depth 3. For this reason, the test performed at 
step S462 determines whether the model is tessellated to 
a depth greater than depth 3 . 

15 

If it is determined at step S462 that" the model is not 
tessellated to a depth greater than depth 3, then, at 
steps S464, S466 and S468, CPU 4 calculates the lighting 
values in - a conventional manner for each vertex in the 

20 model. More particularly, at step S464, CPU 4 considers 
the next triangle in the original model of the object, 
and, at step S466, CPU 4 calculates a value for each 
colour component at each original vertex and each new 
vertex of tessellated triangles in the conventional 

25 manner described above with respect to step S454. At 
step : *S468, CPU 4 determines ' whether" "there i : s another 
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triangle to be processed in the model of the object. 
Steps S464 to S468 are repeated until all triangles in 
the model have been processed in the manner described 
above . 

5 

On the other hand, if it is determined at step S4 6 2 that 
the model is tessellated to a depth greater than depth 
3, at steps S470 to S480, CPU 4 calculates the lighting 
values for the model using "lighting patches", as will 
10 now be described. 

At step S470, CPU 4 considers the next triangle in the 
model of the object, and at step S472 considers the next 
colour component. In this embodiment, the colour 
15 components red, green and blue are used, although other 
colour component schemes may, of course, be used. 

At step S474, CPU 4 calculates parameters defining a 
lighting patch for the triangle being considered and the 
20 colour component being considered. 

Figure 28 shows the processing operations performed by 
CPU 4 at step S474.to calculate the parameters defining 
the lighting patch. 
25 ... ... 

Referring to Figure 28, at step. S500, CPU 4 calculates 
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a value for the colour component at each control point 
of the triangle. The control points of the triangle are 
the ten points shown in, and previously described with 
respect to, Figure 10, namely the triangle vertices, two 
5 points along each edge which divide the edge into thirds 
and a point at the barycentre of the triangle. The value 
for the colour component at each of these points is 
calculated in a conventional manner. For example, in 
this embodiment, an ambient value for the colour 
10 component, a diffuse value for the colour component and 
a specular value for the colour component are calculated 
in dependence upon aii of the light sources present, and 
these values are added to give an overall value for the 
colour component at the given control point. 

15 

At step S502, CPU 4 defines a point above each control 
point at a height corresponding to the calculated value 
of the colour component at that control point. 

20 At step S504, CPU 4 considers the next edge in the 
triangle . * 

At step S506, CPU 4 calculates ordinate values for the 
edge which cause a parametric patch to interpolate the 
25 points defined at step S502 above the control points 
' %iiong' the edge . 'In this embodiment, coordinates are 
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calculated for a cubic Bernstein-Bezier triangular patch. 

Figures 29A and 29B illustrate an example of the effect 
of the processing operations performed at step S506- 

5 

Referring to Figure 29A, points 400, 402, 404 and 406 lie 
on the triangle edge and are the control points for this 
edge of the triangle (points 400 and 4 06 being vertices 
of the triangle, point 402 being spaced one third of the 

10 edge length from point 400, and point 404 being spaced 
one third of the edge length from point 406). Points 
410, 412, 414 and 416 are the points defined at step S502 
at heights above the control points corresponding to the 
value of the colour component at the control points 

15 calculated at step S500. Thus, in this example, point 
410 is at a height hO above point 400 since the value of 
the colour component calculated at point 400 at step S500 
was hO, point 412 is at a height hi above point 402 since 
the value of the colour component calculated at point 402 

20 was hi, point 414 is at a height h2 above point 404 since 
the value of the colour component calculated at point 404 
was h2, and point 416 is at a height h3 above point 406 
since the value of the colour component calculated at 
point 406 was h3. 

25 . - . . 

If the points .410, 412, -414 and 416 are used as ordinates 
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to define a cubic Bernstein-Bezier triangular patch, then 
the edge of the patch will not pass through the points 
412 and 414, and instead will have a position shown by 
the dotted line 418 in Figure 29A. Accordingly, at step 
5 S506, CPU 4 calculates ordinate values which cause the 
edge of a Bernstein-Bezier triangular patch to pass 
through all of the points 410, 412, 414 and 416. The 
ordinate values calculated at step S506 are illustrated 
in Figure 29B and comprise points 410, 420, 422 and 416. 

10 The ordinates for the triangle vertices have the same 
values as the calculated colour component value since the 
edge of the Bernstein-Bezier triangular patch will 
interpolate these end points . Thus, in the example 
shown, the ordinate of point 400 has a value hO and the 

15 ordinate of point 406 has a value h3. 

To calculate the value for the ordinates at points 402 
and 404 along the edge, which are not vertices of the 
triangle, CPU 4 calculates the value of the height hi' 
20 of point 4 20 above point 402 and the value of the height 
h2' of the point 4 22 above the point 404, such that the 
values hi' and h2' cause the Bernstein-Bezier triangular 
patch to interpolate the points 410, 412, 414 and 416. 

25 Each edge of the lighting patch is defined .by : a; cubic 
Bezier polynomial. The equation for a cubic Bezier 
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polynomial of the parameter t and with the control 
ordinates hO , hi', h2' and h3 is: 

h( t) = (1-t) 3 h0 + 3 t(l-t) 2 hl'+ 3 t 2 (1-t) h2'+t 3 h3 /ox 



Evaluating this polynomial at t=l/3 and t=2/3 
5 (corresponding to the positions of the control points 
along the triangle edge) gives: 



10 



JLhO+ — hl' + — h2'+ — h3 
27 9 9 27 



2 ki/. 4 , o/ . 8 



_ hO + — hi' + — h2' + — h3 
27 9 9 27 

But, using the values calculated at step S500: 

Ml)-" 

Therefore, setting 

A3 
A3 

27 27 

15 

Equation 10 becomes: 

^-hl'+ — h2' + cl=hl 
9 9 

Z-hl'+ — h2' + c2=h2 
9 9 

20 which is equivalent to ■ • 



cl = 


8 


h0 + 


1 




27 


27 


c2 = 


1 


h0 + 


8 




27 


27 



..(10) 



(11) 



• • (12) 



(13) 
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*-hl'+ — h2' = hl-cl 
9 9 



— hl'+ — h2' = h2-c2 
9 9 



(14) 



Since Equation 14 is a linear equation it can be solved 
for hi' and h2' using Cramers rule, giving: 



DetO 



1 _2 
9 9 

2 _4 
9 9 



12 
81 



..(15) 



and consequently giving the following equations, which 
CPU 4 uses at step S506 to calculate the ordinate values 
for each internal edge control point (points 402 and 4 04 
in the example of Figures 29A and 29B): 



and 



\hl-cl 4 
9 



h2-c2 — 
9 



h2' = 



12 
81 



— hl-cl 
9 



[hl-cl) ±-{h2-c2) I 
81 



' h2-c2 (h2-c2) ±- {hl-cl) 4 



12 
81 



12 
81 



(16) 



In this embodiment, any ordinate value which is 
calculated at step S506 to be less than zero is set to 
zero, since this has been found to provide subjectively 
better illumination results. 
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Referring again to Figure 28, at step S508, CPU 4 
determines whether there is another edge of the triangle 
to be processed. Steps S504 and S508 are repeated until 
ordinates for each edge control point have been 
calculated in the manner described above. 

At step S510, CPU 4 calculates an ordinate value for the 
control point at the barycentre of the triangle (that is, 
point 108 in the example shown in Figure 10). 

Figure 30 shows the processing operations performed by 
CPU 4 to calculate the ordinate for the central control 
point at step S510. 

In this embodiment, CPU 4 uses the six ordinates 
previously calculated at step S506 for the control points 
lying on the edges of the triangle between vertices, and 
the six original colour component values for these 
control points, to compute a factor for each control 
point, which, when multiplied by the colour component 
value, gives the ordinate value. The six factors are 
then used to calculate an ordinate value for the control 
point at the barycentre of the triangle. This process 
will now be described in more detail. 

Referring to Figure 30, at step S520, CPU 4 sets the 
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value of a variable entitled "sum" to zero. 

At step S522, CPU 4 considers the next control point 
lying on an edge between vertices of the triangle being 
5 considered (referring to the example shown in Figure 10, 
the control points lying on an edge between vertices 
comprise points 92, 94, 98, iOO, 104 and 106) . 

At step S524, CPU 4 reads the value of the colour 
10 component calculated for the control point at step S500, 
and determines whether the value is equal to zero. If 
the value is equal to zero, then, at step S526, CPU 4 
adds one to the value of the variable "sum". On the 
other hand, if the value of the colour component at the 
15 control point is not equal to zero, at step S528, CPU 4 
divides the value of the ordinate at the control point 
calculated at step S506 by the value of the colour 
component of the control point and adds the resultant 
value to the value of the variable "sum". 

20 

At step S530, CPU 4 determines whether there is another 
control point lying between vertices of the triangle. 
Steps S522 to S530 are repeated until each control point 
lying between vertices of the triangle has been processed 
25 in the manner described above.** - - , - 
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At step S532, CPU 4 calculates the value of the ordinate 
for the control point at the barycentre of the triangle 
as the product of (i) the value of the colour component 
at the control point at the barycentre (previously 
5 calculated at step S500), (ii) the value of the variable 
"sum" and (iii) 1/6 (this corresponding to the reciprocal 
of the number of control points lying along edges of the 
triangle between vertices which were used to derive the 
value of the variable "sum"). 

10 

As a result of the processing described above, data has 
been generated which defines a lighting patch which 
interpolates the values of the colour component 
calculated at the control points over the triangle. 

15 

Referring again to Figure 27 , at step S476 , CPU 4 
calculates a value for the colour component at each 
vertex of each tessellated triangle within the original 
triangle currently being considered using the lighting 
20 patch defined by the parameters previously calculated at 
step S474. 

Figure 31 shows the processing operations performed by 
CPU 4 at step S476 to calculate the value for the colour 
25 component at each vertex. 
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Referring to Figure 31, at step S550, CPU 4 considers the 
next vertex for which a value of the colour component is 
to be calculated. 

5 At step S552, CPU 4 determines the barycentric 
coordinates of the point on the original triangle to 
which the vertex corresponds. By way of example, 
referring again to Figure 23B and Figure 25, the point 
on original triangle 32 which corresponds to vertex 270 

10 is the point having barycentric coordinates (1,3,0). 
Similarly the point on the original triangle 
corresponding to vertex 274 is the point having 
barycentric coordinates (3,1,0), and the point on the 
original triangle corresponding to vertex 324 is the 

15 point having barycentric coordinates (1,1,2). 

At step S554, CPU 4 calculates the height of the cubic 
Bernstein-Bezier triangular lighting patch (defined by 
the parameters calculated at step S474) above the point 
20 on the original triangle. This is carried out by 
evaluating the lighting patch equation using the 
barycentric coordinates determined at step S552. The 
equation- of the lighting patch is given by equation 6, 
described previously, with the values of 'the ordinates 

25 ■ b oo3/ : b o3o/ b 3oor b io2> b 2oi / b oi2/ b 02i * ' b i2o and b 2io being those 
previously calculated at step S506 and the value of the 
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ordinate b in being that, previously, calculated at step 
S510. 

At step S556, CPU 4 determines whether there is another 
5 vertex at which a value for the colour component is to 
be calculated. Steps S550 to S556 are repeated until a 
value for the colour component has been calculated at 
each vertex as described above. 

10 Referring again to Figure 27, at step S478, CPU 4 
determines whether there is another colour component for 
which a lighting value at each vertex in the triangle is 
to be calculated. Steps S472 to S478 are repeated until 
a value for each colour component at each vertex in the 

15 original triangle has been calculated in the manner 
described above. 

At step S480, CPU 4 determines whether there is another 
triangle in the model. Steps S470 to S480 are repeated 
20 until each triangle in the model has been processed in 
the manner described above. 

At step S482, CPU 4 determines whether there is a model 
of another object to be processed. Steps S450 to S482 
25 are repeated until each model has been processed in the 
manner described above. 
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Referring again to Figure 2, at step S20, CPU 4 
transforms the triangles making up each object from the 
modelling space of the object into the three-dimensional 
viewing space. More particularly, the concatenated 
5 matrix used to transform the bounding box during the 
operation of object culling at step S14 is used again to 
transform the actual object polygons from object space 
into viewing space. As noted* previous ly, the 

concatenated matrix comprises a matrix defining both a 
10 local transformation which transforms the object from its 
object space into the shared 3D world space and a view 
transformation which transforms the object from the 3D 
world space to the 3D viewing space. 

15 At step S22, CPU 4 carries out a clipping process to 
remove polygons or parts thereof which fall outside the 
field of view defined by the viewing parameters 
previously determined at step S12. In performing the 
clipping process at step S22, CPU 4 uses information 

20 generated previously when objects were culled at step S14 
which identifies the planes of the viewing space which 
each object intersects, thereby reducing the 
computational requirements to perform step S22. 

25 ^At step S24, the triangles of each object are projected 
. into two dimensions in a conventional manner by rejecting 
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the z (depth) dimension and scaling the x and y 
dimensions to take account of the rejected z dimension, 
thereby giving a perspective view* 

5 At step. S26, CPU 4 identifies which of the polygon faces 
are front-facing (that is, face the viewer) and which of 
the polygon faces are back-facing. Back faces are then 
removed since they cannot actually be seen because they 
are obscured by a front face. In this embodiment, in 

10 order to reduce computational overheads, polygon normals 
are only used within object space and are not transformed 
into viewing space. Accordingly, at step S26, CPU 4 
processes vectors defining the polygon edges to determine 
whether a polygon is front facing or back facing. This 

15 is carried out in the manner described in published 
European application EP-A-0590995 . 

At step S28, CPU 4 scan converts the triangle data to 
produce pixel data. This step is carried out in a 
20 conventional manner, and during this step, a colour value 
is calculated for each pixel taking into account the 
values previously calculated at each vertex of each 
triangle using a conventional Gouraud shading technique. 

25 .At step S32, CPU 4 writes the : pixel data to the frame 
buffer 16 on a polygon-by-polygon basis, thereby building 
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up image data for a complete two-dimensional image in a 
conventional manner . 

At step S32, CPU 4 displays the image data written in 
5 frame buffer 16 on display device 18 and/or records the 
image data on a recording device such as video tape 
recorder 20. * - 

At step S34, CPU 4 determines whether image data is to 
10 be generated for another frame. Steps S9 to S34 are 
repeated to generate each frame of image data. It should 
be noted that step S6 , in which the topology database for 
the model is constructed, and step S8, in which the 
parameters for the refinement of the model of each object 
15 are calculated, need not be repeated for each frame of 
image data, provided that the object is not animated (in 
which case the triangular patches making up the object 
would change), although the object position may change 
(since this does not affect the triangles making up the 
20 object). However, the techniques described above can be 
used in animation to define triangle vertices for each 
"key-frame", with interpolation being used to calculate 
the triangle vertices for* "in-between frames" in a 
conventional manner . 

25 

A number of modifications are possible to the embodiment 
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described above. 

In the embodiment above, a cubic Bernstein-Bezier 
triangular patch is used to refine each triangle of a 
5 model, and a cubic Bernstein-Bezier triangular patch is 
used to determine the lighting patch for each triangle 
of a model. However, higher order Bernstein-Bezier 
triangular patches may be used to refine a triangle 
and/or to define the lighting patch for a triangle, 

10 Higher order patches have limited usefulness, however, 
when used to refine a triangle, since the information 
available to calculate the ordinates for each of the 
extra control points required by the higher order 
equation (step S2 34 in Figure 9) is limited (because only 

15 the normal at each vertex of the original triangle is 
known) . 

Patches of types other than Bernstein-Bezier triangular 
patches may be used to refine a triangle and/or to define 
20 the lighting patch for a triangle. One example of such 
an alternative type of patch is the Herron patch, 
although other types of patches can be used. The 
equation for a Herron patch, h(x), is as follows: 
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h(x) = £ b x H x (x) 

- ifjri • - - 

< ....(17) 
0 for X = (l # l,l) 

H k (x)= \ k . . 

[ 3 ti^T^jf or X* (1,1,1) 

where: A is the triplet (X lf X 2f X 3 ) of barycentric 
coordinates which identifies the position of 
5 a control point; and 

h x is the value of the ordinate at the control 
point X . 

In the embodiment above, the ordinates at the vertices 
10 of a triangle are assigned the value 0 so that the patch 
interpolates these vertices. Further, the Herron 
polynomial is zero for the central ordinate, and hence 
a value for b ul is never needed, 

15 In the embodiment above, the model of each object 
comprises triangles. The natural barycentric coordinate 
system for triangles assists in the computation described 
for the embodiment above. However, each object may be 
modelled using other forms of polygons and patches other 

20 than triangular patches may be used to refine each 
pplygon and/or to determine the lighting patch for each 
polygon. . In particular, each object may be modelled 
using rectangles. If polygons having five or more sides 
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are used, the amount of computation required increases 
significantly, however, and real time operation may not 
be possible. 

5 The refinement of the model of each object (step S16 in 
Figure 2 in the embodiment above) can be carried out at 
other places in the rendering pipeline shown in Figure 
2. For example, the refinement can take place after the 
polygons have been lit at step S18. 

10 

In the embodiment above, all of the triangles in each 
model are refined at step SI 8 before subsequent 
processing takes place. However, processing may be 
carried out so that steps S16 to S30 are carried out on 
15 a polygon-by-polygon basis. 

In the embodiment above, at step S6, the topological 
database for the model of each object is constructed. 
However, this information may be received with the 3D 
20 modelling data. 

The information stored in the topological database in the 
embodiment above enables triangles which share a given 
edge to be identified. By looking at the current viewing 
25 parameters (determined at step S12) arid considering the 
triangle normals of both triangles sharing an edge, it 
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is possible to determine if the edge is part of" the 
silhouette of the object. More particularly, if one 
triangle normal points towards the viewer making the 
triangle visible and the other points away from the 
viewer, then the edge is part of the silhouette. This 
information can be used during step S16 to apply a high 
sub-division depth for triangles that are part of the 
silhouette. 

In the embodiment above, at step S18, the triangles 
making up the model of each object are lit in object 
space. However, the triangles may be transformed into 
the three-dimensional world space for the lighting 
calculations to be performed. 

In the embodiment above, to calculate an ordinate for 
each edge control point (step S234 in Figure 9), the 
distance of the tangent plane passing through the nearest 
vertex from the control point is calculated in a 
direction parallel to the normal at the nearest vertex 

(step S262 in Figure 11). However, this distance may be 
•calculated in other directions. For example, a direction 
may ' be calculated for each control point based on a 
weighting of the normal at each vertex of the triangle 
'(the weighting of - each vertex being determined by its 
distance from the control point ) . Alternatively, a 
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direction may be calculated based on the average of the 
normals at the vertices at the ends of the edge, which 
would cause the values of the ordinates to be slightly 
bigger than if they were calculated using a direction 
5 parallel to the normal at the nearest vertex as in the 
embodiment above (and hence would cause the surface to 
be more curved). Further, a direction parallel to the 
triangle normal may be used (although this may cause gaps 
between adjacent triangles, which would then be filled 
10 by generating "stitching triangles" for example as at 
step S406 in the embodiment above). 

In the embodiment above, at step S234 (Figure 9), CPU 4 
calculates a value for the. ordinate at each vertex and 

15 each edge control point. However, as explained above, 
when the keep_edge flag is set for an edge, the ordinates 
are calculated to be zero. Accordingly, the apparatus 
may be arranged to test whether the keep_edge flag is set 
for an edge and to set the ordinate values to zero rather 

20 than perform the calculations. 

In the embodiment above, at step S306 (Figure 15), the 
depth of tessellation for a triangle is determined in 
dependence upon both the area occupied by the triangle 
25 in the. previous frame of image data and the curvature of 
the triangle (determined from the difference in angles 
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of the normals at the vertices of the triangle). 
However, the depth may be determined from the area of the 
triangle in the previous frame alone or in dependence 
upon the curvature of the triangle alone. Also, the 
5 depth may be determined from the area of the triangle in 
any preceding frame, and not necessarily the immediately 
preceding frame (although the more remote the preceding 
frame which is used, the more time the object will have 
had to move, and hence the more chance there is that the 

10 area used is not indicative of the area for the current 
frame). In addition, other techniques may be used. For 
example, the depth of the triangle from the viewer in the 
previous (or any preceding) frame may be used. By way 
of further example, a bounding sphere may be defined 

15 around the object in object space, the bounding sphere 
may be then projected into two-dimensional screen space, 
the area of the projected sphere calculated, and one half 
of the calculated area divided by the number of polygons 
in the model of the object to give an average polygon 

20 area, which may be then used to determine the depth of 
sub-division. In this way, a polygon area for the 
current frame (rather than a preceding frame) is used to 
determine the sub-division depth. Of course, each 
individual polygon can be : projected into two-dimensional 

25 - screen space , and its area and sub-division depth 
determined for the * current frame. — Further; * size 
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parameters other than area may be used to determine the 
sub-division depth. For example, the length of the 
longest edge of the polygon in screen space may be used, 
as this too is indicative of the size of polygon that 
5 will be displayed to the user and hence the number of 
polygons into which the original polygon should be 
divided to display the required detail . 

In the embodiment above, each triangle is divided for 
10 tessellation in a manner previously described with 
respect to Figures 19A, 19B and 19C. However, each 
triangle may be divided in other ways . 

In the embodiment described above, at step S3 6 6 (Figure 
15 18), when a triangle is divided, a normal is calculated 
for each . new vertex using linear interpolation of the 
normals from the vertices of the original triangle. This 
normal is subsequently used at step S368 to determine the 
position of a point lying off the surface of the original 
2 0 triangle which is then used as a vertex in the refined 
representation of the triangle. However, the normal may 
be calculated at step S366 using techniques other than 
linear interpolation. For example, angular interpolation 
may be performed of the normal of each vertex. Such 
25 interpolation. may be based,, for example, on the technique 
.described in "Stratified Sampling of Spherical Triangles" 
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by J. Avro, Computer Graphics Proceedings, STGGRAPH 
(1995), pages 437-438. 

The height of the Bernstein-Bezier patch calculated at 
5 step S364 (Figure 18) in the embodiment above may be 
scaled by a constant to increase or decrease the height. 
The effect of this constant is to control how closely the 
refined surface fits the shape of the original object. 
Thus, for example, an artist drawing an object can 

10 associate a constant with the object indicating what form 
the object surface should take. By way of example, an 
object comprising a sphere may appear as a cube if it is 
coarsely approximated by triangles. To address this, in 
the embodiment above, a constant of 1.267927822449 may 

15 be associated with the object and used to refine the 
height calculated at step S364 so that the model is 
refined to better approximate the originally intended 
sphere. 

20 In the embodiment above, at steps S402 to S408 (Figure 
22), "stitching" triangles are generated to fill the gap 
between each pair of edges for which the 
edge_normals_ambiguous flags are set but the keep_edge 
flags are riot set. —These stitching triangles may, 

25 * however, be generated - a f ter ' s can conversion "has taken 
place. :: In addition, a' different technique may be used 
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to prevent the requirement for stitching triangles at 
all. More particularly , the gap between two triangles 
for which the edge_normals_ambiguous flags but not the 
keep_edge flags are set (as shown in Figure 21D) arises 
5 because: 



(i) the value of the ordinate at at least one internal 
control point along the edge is calculated at step 
S262 (Figure 11) to be different for each triangle 

10 sharing the edge because the normals at the nearest 

vertex are different for the two triangles for at 
least one vertex; and 

(ii) at step S368 (Figure 18), the position of the new 
15 vertex for at least one internal control point on 

the edge is calculated to be different for the two 
triangles sharing the edge because the direction of 
the normal along which the distance is measured at 
step S36 8 is calculated to be different for the two 
20 triangles at step S366 since each triangle has 

different normals at at least one vertex. 

To prevent the gap between two triangles sharing the edge 
occurring, therefore, at step S262, the distance from the 
25 control point of. the tangent plane which passes through 
the nearest vertex may be measured in- a direction 
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parallel to the average of the normal of the first 
triangle and the normal of the second triangle at the 
nearest vertex . In this way, the ordinates calculated 
for the edge are the same for each triangle, 
5 Accordingly, at step S364 (Figure 18), the height of the 
Bernstein-Bezier patch will be the same for each 
triangle. In addition, a normal may be calculated at 
step S36 6 by interpolating the average of the normals of 
the two triangles at the vertex at one end of the edge 

10 and the average of the normals for the two triangles at 
the vertex at the other end of the edge, so that the 
position of the new vertex is calculated at step S368 to 
be the same for each of the triangles sharing the edge. 
In this way, no gap appears along the edge. This 

15 approach has the advantage that unnecessary "stitching" 
triangles are not generated, which can occur in the 
embodiment described above if the refinement of the 
triangles sharing an edge results in surfaces which 
intersect each other (so that no gap actually occurs). 

20 

In the embodiment above, whether or not a lighting patch 
is used to calculate the lighting values for each 
triangle- is determined in dependence upon the depth of 
tessellation * of the model (step S462 in Figure 27) . 
25 ; Instead, or in addition, the use of a lighting patch may 
be determined in dependence upon the curvature' of the 



95 



2583301 



surface of each individual triangle within the model. 

In the embodiment described above, at step S4 66, when a 
lighting patch is not used to calculate lighting values 
5 (because the model is tessellated to depth 3 or less) a 
value for each colour component at each original vertex 
and each tessellated vertex is calculated. However, 
instead of calculating a value at each tessellated 
vertex, it is possible to interpolate the values 
10 calculated at one or more of the original vertices to 
generate a value at a tessellated vertex. This works 
particularly well for tessellated vertices corresponding 
to control points on a flat edge if the calculated value 
at the vertex at each end of. the edge is interpolated. 

15 

If an application can tolerate. lower quality 
illumination, then a lighting patch need not be used to 
calculate the lighting values, and instead the colour at 
each vertex generated by tessellation can be calculated 

20 by linear interpolation from the colours calculated at 
the original vertices. Further, this allows 

computational performance to be increased. More 
particularly, ordinates could be calculated from object 
space triangle data as in the embodiment above, but, 

25 rather than refining each, triangle . to generate new 
vertices in object space as .in. the embodiment above, the 
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new vertices can be generated in viewing space (camera 
space) . In this way, the new vertices do not need to be 
transformed from object space to viewing space, yielding 
an increase' in performance. 

Although not mentioned in the description of the 
embodiment above, texture mapping may be performed. For 
example, texture coordinates defined at vertices of a 
triangle may be interpolated using barycentric 
coordinates at the same time as new vertices are 
generated during tessellation to define texture 
coordinates at the tessellated vertices . 

In the embodiment above, when calculating the position 
of a new vertex, at step S364, the height of the 
Bernstein-Bezier patch is calculated by evaluating the 
cubic Bernstein-Bezier triangular patch equation for each 
vertex on the original triangle for which a height is to 
be calculated. Similarly, when calculating a lighting 
value using a lighting patch, at step S554, the height 
of the Bernstein-Bezier lighting patch above the original 
triangle is calculated by evaluating the cubic Bernstein- 
Bezier triangular lighting patch equation for each vertex 
on the original triangle for which a height is to be 
calculated. However , in ' both step S364 ^and step S554, 
the height of the Bernstein-Bezier triangular patch may 
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be calculated for successive points on the original 
triangle using a conventional forward, differencing 
technique, for example as described in "Computer Graphics 
Principles & Practice" by Foley, van Dam, Feiner & 
5 Hughes, 2nd Edition, Addison-Wesley Publishing Company, 
1990, ISBN 0-201-12110-7, pages 511-513. The parameters 
for use in such a forward differencing technique will now 
be described. 

10 The parameters for use at step S364 will be described 
first. 

As described previously with respect to Figure 25, when 
travelling parallel to an edge of a triangle, one of the 

15 barycentric coordinates of the triangle vertices remains 
constant. For example, in Figure 25, when moving between 
the points along the edge defined by vertices having 
barycentric coordinates (4,0,0) and (0,0,4) and when 
moving between points in a direction parallel to this 

20 edge, the second barycentric coordinate is constant. 
That is, x 2 is constant. Because x 1 +x 2 +x 3 =l, setting x 2 =c 
gives x x =l-c-x 3 . Therefore, equation (6) becomes: 

f(^s)= b3 00 (l-c-T3) 3 +b 0 3oC?+b 0 o 3 T:3 3 + 

25 3b 2 oi(l-C-X3) 2 X 3 +3b 1 o2(l-C-T3)T3 2 + 

3b 2 io ( 1 -c-x 3 ) 2 c+3b 120 ( l-c-x 3 ) c 2 + 
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3b 021 c 2 T 3 +3b 012 CT 3 2 + - 

6b 111 (l-c-T 3 )CT 3 ...(18) 
Reordering equation (18) gives: 

5 

f(x 3 )= -■C3 3 (b 3 oo-3b 201 +3b 1 o2-boo3) + 

- 3t 3 2 ( c ( b 300 -b 2 i 0 -2b2oi + 2b 111 +b 10 2-boi 2 ) -b 3 oo + 2b 201 -b 10 2 ) + 
-3T 3 (c2(b 300 -2b 210 +bo2 1 -b 201 +2b 111 -b 021 )-2c(b 300 -b 210 - 
b 2oi+t>i 1 1 ) +b 300 -b 201 ) + 

10 - c3 ( t>3oo-3b 210 +3b 12 o-b 0 3o ) + 3c 2 ( b 30 o-2b2io+b 12 o ) -3c ( b 300 - 

b 2 io) + b 30 o 

...(19) 

Now, b 300 =b O3O =b 003 =0 . Therefore, equation (19) simplifies 
15 to: 

f(x 3 )= 3T 3 3 (b 201 -b 102 ) + 

3x 3 2 [ c ( b 21 o+2b 2 o 1 -2b 111 -b 102 +b 012 ) -2b 201 +b 102 ] + 
3x 3 [ c 2 ( 2b 210 -b 120 +b 2 oi-2b 111 + b 0 2i ) - 2 c ( b2io+b 20 i - 
20 b m )+b 201 ] + 

3c(c-l) [c(b 210 -b 120 )-b 210 ] ... (20) 

Equation (20) is a cubic polynomial of the form f(x 3 ) = 
At 3 3 +Bt 3 2 +Ct 3 +D. Re-substituting c with x 2 . again, the 
25 coefficients of f(r 3 ) are: 



A— 3b 20 i — 3bjQ 2 

B= 3T 2 (b 21 o+2b 2 oi-2b 111 -b J o2 + b 01 2)-3(2b 2 oi+b 102 ) 

>201 



3x 2 2 ( 2b 2 io-b 12 o- , -b 201 -2b 111 +b 0 2 1 )-6T 2 (b2io + b2oi-b m ) + 3b 2 
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D= 3t 2 3 ( b 210 -b 12 o ) +t 2 2 ( 3b 120 -6b 2 io ) + 3T 2 b 210 

... (21) 

Since equation (20) is a cubic polynomial of x 3 we can 
5 forward difference it for a constant x 2 and a constant t 3 
step 6 3 using the following start values: 



f 0 = D 

Af 0 = A6 3 3 +B6 3 2 +C6 3 
10 A 2 f 0 = 6A6 3 3 + 2 B6 3 2 

A 3 f 0 = 6AS 3 3 ... ( 22 ) 



Further, B, C and D can also be forward differenced for 
a constant x 2 step 6 2 using the following start values: 



15 



B 0 = -3(2b 201 -b 102 ) 

AB 0 = 3 (b 210 +2b 201 -2b lu -b 102 +b 012 )6 2 

Co = 3b 2 oi 

AC 0 = 3 ( 2b 21 o-b 120 +b 201 -2b in +bo 2 i ) 6 2 2 - 6 ( b 210 +b 201 -b lu ) 6 2 
20 A 2 C 0 = 6(2b 210 -b 120 +b 201 -2b ni +b 021 ) 8 2 2 
D 0 = 0 

AD 0 = 3 (b 210 -b 120 ) 6 2 3 + ( 3b 120 -6b 210 ) 6 2 2 + 3b 210 6 2 

A 2 D 0 = 1 8 ( b 210 -b 120 ) 6 2 3 +2 ( 3b 120 -6b 210 ) 6 2 2 

A 3 D 0 = 18(b 210 -b 120 )6 2 3 ...(23 ) 



25 



This concludes the parameters for performing forward 
differencing at step S364. 
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The parameters for use in performing forward differencing 
at step S554 will now be described. 



003 



For the illumination patch algorithm, b 300 , b 030 and b 
are generally not 0. Therefore, in order to apply 
forward differencing for the illumination patch, 
equation (19) is used. Equation (19) is a cubic 
polynomial of the form f(x 3 )= Ax 3 3 +Bx 3 2 +Cx 3 +D . Re- 
substituting c with x 2 again, the coefficients of f(x 3 ) 
are : 

A= koo3 + 3b 20 i-3b 102 -b 300 



B= 



3T 2 (b 210 +2b 201 -2b m -b 102 +b 012 -b 30 o)-3(2b 201 +b 102 -b 300 ) 
C= 3x 2 2 ( 2b 210 -b 120 +b 201 -2b m +b 021 -b 3 oo ) -6x 2 ( b 210 +b 201 -b m ) + 3 ( b 201 - 
b,n) 

D= V(3b 210 -3b 120 -b 300 +b 030 )+3T 2 2 (b 120 -2b 210 -b 300 ) + 3r 2( b 210 - 

... (24) 

Since equation (24) is a cubic polynomial of x 3 it can be 
forward differenced for a constant x 2 and a constant x 3 
step 6 3 using equation (22). 

Similarly, B, C and D can be forward differenced for a 
constant x 2 step S 2 using the following start values: 



B 0 - 3 (b 300 -2b 201 +b 102 ) 
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AB 0 = -3 (b 300 -b 210 -2b 201 +2b m +b 102 -b 012 ) 6 2 
Co = -3 (b 30 o-b 2 oi ) 

AC 0 = -3 (b3oo-2b 21 o-*-b 120 -b 2 oi + 2b 111 -b 021 ) 6 2 2 +6 (b 30 o-b 210 - 
bzoi+biii ) 6 2 

5 A 2 C 0 = -6 (b 300 -2b 210 +b 120 -b 201 +2b 111 --b 021 ) 6 2 2 
D o~ b 300 

AD 0 = (b 030 +3b 210 -3b 120 -b 30 o) S 2 3 +3 (b 00 3" ! "b 120 -2b 210 ) 6 2 2 +3 (b 210 -b 300 ) 62 
A 2 D 0 = 6 ( b 030 +3b 210 -3b 120 -b 300 ) 6 2 3 +6 ( b 003 +b 120 -2b 210 ) 6 2 2 
A 3 D 0 = 6 (b 030 +3b 210 -3b 120 -b 300 ) 6 2 3 
10 . . . (25) 

In the embodiment above, processing is performed by a 
computer using processing routines defined by programming 
instructions. However, some, or all, of the processing 
15 could be performed using hardware. 
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CLAIMS 

1. A method of processing data defining first polygons 
which approximate a curved three-dimensional surface to 

5 produce second polygons for use in rendering an image of 
the surface, the method including for each first polygon 
the steps of: 

defining a respective surface patch to approximate 
the part of the object surface represented by the first 
10 polygon; 

dividing the first polygon into a plurality of 
notional polygons; and 

for each notional polygon , defining a said second 
polygon for rendering using the surface patch of the 
15 first polygon to determine the positions of the vertices 
of the second polygon in three dimensions , 

2. A method according to claim 1, wherein the first 
20 polygons approximating the curved three-dimensional 

surface are triangular, and a Bernstein-Bezier triangular 
patch is defined as the surface patch for each first 
polygon. 

25 3. A method according to claim 2, wherein a *cu£ic 
Bernstein-Bezier triangular patch is defined for each 
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first polygon. 

4. A method according to any preceding claim, wherein 
the step of defining a surface patch for a first polygon 

5 comprises calculating control values at control points 
for the first polygon to define the surface patch. 

5. A method according to claim 4, wherein the control 
values for each vertex of the first polygon are set to 

10 zero. 

6. A method according to claim 4 or claim 5, wherein 
the control values for control points along an edge other 
than vertices are calculated by determining the distance 

15 from the control point of the tangent plane at the 
nearest vertex in a predetermined direction. 

7. A method according to claim 6, wherein the 
predetermined direction is based on the direction of the 

20 normal at the nearest vertex alone. 

8. A method according to claim 6, wherein the 
predetermined direction is based on the normal at each 
vertex defining the ends of the edge on which the control 

25 point lies. 
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9". A method according to claim 1, wherein each surface 
patch is a Herron patch. 

10. A method according to any preceding claim, wherein, 
5 in the step of dividing a first polygon into notional 
polygons, the division is performed in dependence upon 
at least one of the size of the first polygon in a 
previous frame" of image data, the size of the first 
polygon in the current frame of image data, the curvature 
10 of the first polygon, the distance of the first polygon 
from the viewing position in a previous frame of image 
data, and the distance of the first polygon from the 
viewing position in the current frame of image data. 

15 11. A method according to any preceding claim, wherein, 
each first polygon is divided into the same number of 
notional polygons. 

12. A method according to claim 11, wherein the number 
20 of notional polygons is determined by testing each first 
polygon to determine a division number therefor defining 
a number of notional polygons, and selecting the highest 
division number. 



25 



13. A method according to" claim '11 'or claim 12, "wherein: 
' processing is performed for each frame of image data 
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to be generated to determine a level of subdivision 
defining the number of notional polygons into which each 
first polygon is to be divided; 

data defining the second polygons produced for 
5 rendering is stored for future use when it is generated 
for a level of subdivision for which data is not already 
stored; and 

the stored data is used when a frame of image data 
is to be generated for a level of subdivision for which 
10 data is already stored. 

14. A method according to any preceding claim, wherein 
each said second polygon is a triangle. 

15 15. A method according to any preceding claim, wherein, 
in the step of defining a second polygon for a notional 
polygon, vertices for the second polygon are calculated 
in dependence upon the distance of the surface patch 
above each vertex of the notional polygon. 

20 

16. A method according to claim 15, wherein, in the step 
of defining a second polygon for a notional polygon, 
vertices for the second polygon are calculated by: 

(i) calculating the distance of the surface patch 
25 above each vertex of the notional polygon; 

(ii) calculating a normal at each vertex of the 
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notional polygon; and 

(iii) for each vertex of the notional polygon, 
setting the position of a vertex for the second polygon 
at the point which lies a distance from the vertex of the 
5 notional polygon equal to the distance calculated in step 

(i) in the direction of the normal calculated in step 

(ii) . 

17. A method according to claim 16 , wherein a forward 
10 differencing technique is used to calculate the distance 

of the surface patch above each vertex of each notional 
polygon. 

18. A method according to any preceding claim, further 
15 comprising the step of filling gaps between the second 

polygons generated for rendering. 

19. A method according to claim 18, wherein gaps are 
filled by moving vertices of second polygons generated 

20 for rendering. 

20. A method according to claim 18 or claim 19, wherein 
gaps are filled by connecting vertices of second polygons 

to form further polygons for rendering. 

25 - . - - • -' - - : - . : '- ' ~- - 

21. A method according to any of claims 18 to 20, 
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wherein gaps to be filled are identified using a database 
defining, for each edge of each first polygon, the 
relationship between the normals at each vertex of the 
first polygons which share the edge. 

5 

22. A method according to any preceding claim, wherein 
the step of defining a surface patch is performed by 
processing data in object space, and the step of defining 
second polygons is performed in viewing space . 

!0 

23. A method according to any preceding claim, further 
comprising the step of calculating lighting values for 
each second polygon by evaluating a polygon lighting 
equation for at least one of ambient, diffuse and 

15 specular light. 

24. A method according to claim 23, wherein polygon 
lighting equations are evaluated to define a respective 
second surface patch for at least some of the first 

20 polygons, and lighting values are calculated for the 
second polygons thereof using the second surface patches. 

25. A method according to claim 23 or claim 24, wherein, 
in the step of calculating lighting values, the number 

25 of notional polygons into which each surface patch is 
divided is determined, and: 
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(i) if the number of notional polygons is less than 
a predetermined number, a lighting value is calculated 
for each vertex of the second polygons by evaluating the 
lighting equation for each vertex; and 
5 (ii) if the number of notional polygons is greater 

than a predetermined number, a respective second surface 
patch is calculated for each first polygon, and a 
lighting value is calculated for each vertex of the 
second polygons using the second surface patches. 

10 

26. A method according to claim 24 or claim 25, wherein 
the step of calculating a second surface patch for a 
first polygon includes the steps of: 

(i) evaluating the lighting equation to calculate 
15 a lighting value at a plurality of control points for the 

first polygon; and 

(ii) calculating values defining the second surface 
patch such that the surface patch interpolates the 
lighting values calculated at the control points. 

20 

27. A method according to any of claims 24 to 26, 
wherein, in the step of using a second surface patch to 
calculate a lighting value for a vertex of a second 
polygon, the lighting* value is calculated using the 

25 height of the second surface patch* "above the "first 
polygon at the vertex of a notional polygon which 
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corresponds to the vertex for which the lighting value 
is to be calculated. 

28. A method according to claim 27, wherein a forward 
5 differencing technique is used to calculate the height 

of the second surface patch above each vertex of each 
notional polygon. 

29. A method according to any preceding claim, further 
10 comprising the step of generating a signal conveying the 

second polygons . 

30. A method according to any preceding claim, further 
comprising steps to produce rendered image data. 

15 

31. A method according to claim 30, further comprising 
the step of generating a signal conveying the rendered 
image data . 

20 32. A method according to claim 31, further comprising 
the step of recording the signal. 



25 



33. A method according to any of claims 30 to 32, 
further comprising the step of displaying an image using 
the rendered image data. . 
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34, A method according to any of claims 30 to 33, 
further comprising the step of making a recording of the 
image data either directly or indirectly. 

5 35. A method of generating polygons approximating the 
surface of a three-dimensional object for use in 
rendering an image of the object, in which: 

an initial polygonal model of the surface is 
processed to generate a mesh of surface patches 
10 approximating the surface; and 

a further polygonal model of the surface is 
generated using the surface patches. 

36. Apparatus for processing data defining first 
15 polygons which approximate a curved three-dimensional 

surface to produce second polygons for use in rendering 

an image of the surface, comprising: 

patch defining means for defining a respective 

surface patch for each first polygon to approximate the 
20 part of the object surface represented by the first 

polygon; 

dividing means for dividing each first polygon into 
a plurality of notional polygons; and 

polygon defining means for defining, for each 
25 notional polygon, a said second polygon for rendering 
using - the surface patch of the corresponding first 
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polygon to, determine the positions of the vertices of the 
second polygon in three dimensions. 

37. Apparatus according to claim 36, wherein the first 
5 polygons approximating the curved three-dimensional 
surface are triangular, and the patch defining means is 
operable to define a Bernstein-Bezier triangular patch 
as the surface patch for each first polygon. 

10 38. Apparatus according to claim 37, wherein the patch 
defining means is operable to define a cubic Bernstein- 
Bezier triangular patch for each first polygon. 

39. Apparatus according to any of claims 36 to 38, 
15 wherein the patch defining means comprises means for 

calculating control values at control points for the 
first polygon to define the surface patch. 

40. Apparatus according to claim 39, wherein the patch 
2 0 defining means is arranged to set the control values for 

each vertex of the first polygon to zero. 

41. Apparatus according to claim 39 or claim 40, wherein 
the patch defining means is arranged to calculate the 

25 control values for control points along an edge other 
than vertices by determining the distance from the 
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control point of the tangent plane at the nearest vertex 
in a predetermined direction. 

42. Apparatus according to claim 41 , wherein the 
5 predetermined direction is based on the direction of the 

normal at the nearest vertex alone. 

43. Apparatus according to claim 41 , wherein the 
predetermined direction is based on the normal at each 

10 vertex defining the ends of the edge on which the control 
point lies . 

44. Apparatus according to claim 36, wherein the patch 
defining means is operable to define a Herron patch for 

15 each first polygon. 

45. Apparatus according to any of claims 36 to 44, 
wherein the dividing means is arranged to perform the 
division in dependence upon at least one of the size of 

20 the first polygon in a previous frame of image data, the 
size of the first polygon in the current frame of image 
data, the curvature of the first polygon, the distance 
of the first polygon from the viewing position in a 
previous frame of image data, and the distance of 'the 

25 first polygon from the viewing position in the current 
• frame of image - data . 



113 



2583301 



46. Apparatus according to any of claims 36 to 45, 
wherein the dividing means is arranged to divide each 
first polygon into the same number of notional polygons . 

5 47. Apparatus according to claim 46, wherein the 
dividing means is arranged to determine the number of 
notional polygons by testing each first polygon to 
determine a division number therefor defining a number 
of notional polygons, and selecting the highest division 
10 number. 

48. Apparatus according to claim 46 or claim 47, 
operable such that: 

processing is performed for each frame of image data 
15 to be generated to determine a level of subdivision 
defining the number of notional polygons into which each 
first polygon is to be divided; 

data defining the second polygons produced for 
rendering is stored for future use when it is generated 
20 for a level of subdivision for which data, is not already 
stored; and 

the stored data is used when a frame of image data 
is to be generated for a level of subdivision for which 
data is already stored. 

25 . , r . . _ ; . ; _ _ : . 

49. Apparatus according to any of ..claims 36 to.. 48, 
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wherein each said second polygon is a triangle. 

50. Apparatus according to any of claims 36 to 49, 
wherein the polygon defining means is arranged to 
calculate vertices for each second polygon in dependence 
upon the distance of the surface patch above each vertex 
of the notional polygon. 

51. Apparatus according to claim 50 , wherein the polygon 
defining means comprises: 

(i) means for calculating the distance of the 
surface patch above each vertex of the notional polygon; 

(ii) means for calculating a normal at each vertex 
of the notional polygon; and 

(iii) means for setting, for each vertex of the 
notional polygon, the position of a vertex for the second 
polygon at the point which lies a distance from the 
vertex of the notional polygon equal to the distance 
calculated by means (i) in the direction of the normal 
calculated by means (ii). 

52. Apparatus according to claim 51, wherein the means 
for calculating the -distance of the surface patch above 
each vertex of each notional polygon is arranged to 

'calculate the distance" using a forward* differencing 
technique . 
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53- Apparatus according to any of claims 36 to 52, 
further comprising means for filling gaps between the 
second polygons generated for rendering. 

5 54. Apparatus according to claim 53/ wherein the means 
for filling gaps is arranged to fill gaps by moving 
vertices of second polygons generated for rendering. 

55. Apparatus according to claim 53 or cla.im 54, wherein 
10 the means for filling gaps is arranged to fill gaps by 

connecting vertices of second polygons to form further 
polygons for rendering. 

56. Apparatus according to any of claims 53 to 55, 
15 wherein the means for filling gaps includes means for 

identifying gaps to be filled using a database defining, 
for each edge of each first polygon, the relationship 
between the normals at each vertex of the first polygons 
which share the edge . 

20 

57. Apparatus according to any of claims 36 to 56, 
wherein the patch defining means is arranged to define 
the surface patches by processing data in object space, 
and the polygon defining means is arranged to define the 

25 second . polygons, by . performing processing in viewing 
space . , 
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58 . Apparatus according to any of claims^ 36 to 57 , 
further comprising means for calculating lighting values 
for each second polygon by evaluating a polygon lighting 
equation for at least one of ambient , diffuse and 
specular " light . 

59. Apparatus according to claim 58, wherein the means 
for calculating lighting values is arranged to evaluate 
polygon lighting equations to define a respective second 
surface patch for at least some of the first polygons, 
and to calculate lighting values for the second polygons 
thereof using the second surface patches. 

60. Apparatus according to claim 58 or claim 59, wherein 
the means for calculating lighting values is arranged to 
determine the number of notional polygons into which each 
surface patch is divided, and: • ' 

(i) if the number of notional polygons is less than 
a predetermined number, to calculate a lighting value for 
each vertex of the second polygons by evaluating the. 
lighting equation for each vertex; and 

(ii) if the number of notional polygons is greater 
than a predetermined number, to calculate a . respective 
second surface patch for each -first polygon,* and to 
calculate a lighting value -for each vertex' of the second 
polygons using the second surface patches, v ■-. 
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61. Apparatus according to claim 59 or claim 60, wherein 
the means for calculating lighting values is arranged to 
calculate the second surface patch for a first polygon 
by: 

(i) evaluating the lighting equation to calculate 
a lighting value at a plurality of control points for the 
first polygon; and 

(ii) calculating values defining the second surface 
patch such that the surface patch interpolates the 
lighting values calculated at the control points. 

62. Apparatus according to any of claims 59 to 61, 
wherein the means for calculating lighting values is 
arranged to perform processing to use a second surface 
patch to calculate a lighting value for a vertex of a 
second polygon by calculating the lighting value using 
the height of the second surface patch above the first 
polygon at the vertex of a notional polygon which 
corresponds to the vertex for which the lighting value 
is to be calculated. 

63. Apparatus according to claim 62, wherein the means 
for calculating lighting values is arranged to use a 
forward differencing technique to calculate the height 
of. the second surface patch above each vertex of each 
notional polygon. 



118 



2583301 



64. Apparatus according to any of claims 36 to 63, 
further comprising means for producing rendered image 
data . 

65. Apparatus according to claim 64, further comprising 
means for displaying an image using the rendered image 
data . 

66. Apparatus for generating polygons approximating the 
surface of a three-dimensional object for use in 
rendering an image of the object, comprising: 

means for processing an initial polygonal model of 
the surface to generate a mesh of surface patches 
approximating the surface; and 

means for generating a further polygonal model of 
the surface using the surface patches. 

67. A storage device storing computer-useable 
instructions for causing a programmable processing 
apparatus to become configured to perform a method as set 
out in any of claims 1 to 35. 

68. A signal conveying computer-useable instructions 
for causing a programmable processing apparatus to become 
configured to perform a method as set out in . any of 
claims 1 to 35 . 
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ABSTRACT 

APPARATUS AND METH O D FOR RENDER TNG SURFACES IN 3D 

rnvpiiTRR GRAPHICS 

in a computer graphics apparatus, a three-dimensional 
object is modelled using a mesh of triangles which 
approximate the object surface. To display images, each 
triangle is sub-divided into smaller triangles, which do 
not necessarily lie in the same plane as the original 
triangle. In this way, the curvature of the object 
surface can be more accurately modelled. A parametric 
patch, such as a Bemstein-Bezier triangular patch or 
Heron patch, is used to determine how to divide each 
triangle into smaller non-planar triangles. In addition, 
the number of non-planar triangles is determined using 
the size of the original triangle in the current or a 
preceding frame of image data. The non-planar triangles 
are stored for use in subsequent frames which require the 
same number of non-planar triangles, thereby reducing 
processing requirements. Rather than carry out lighting 
calculations for the vertex of each new non-planar 
triangle, lighting values are calculated and used to 
define a parametric patch which is subsequently used to 
determine lighting values for the new triangles. 
(FIGURE 2) 
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TRIANGLE 



CALCULATE THE DOT PRODUCT 
OF THE NORMAL VECTOR AT 
THE VERTEX AT EACH END OF 
THE EDGE 



S80 



S82 



S84 



S88 



S90 



S92 



S93 



CONSTRUCT A TWO- 
DIMENSIONAL DATA STRUCTURE 
FROM THE IDs OF THE VERTICES 
OF THE EDGE 



ASSIGN AN ID TO THE EDGE 



S94 



S96 



FIG. 4 



© 



© ® 



Page Blank (uspto) 




YES 



RESERVE MEMORY SPACE FOR 
EACH TRIANGLE SHARING THE 
EDGE FOR STORING EDGE 
FLAGS 



S106 




S104 




CALCULATE NORMALISED 
NORMAL FOR EACH TRIANGLE IN 
THE MODEL 



S108 



SET EDGE FLAGS 



S110 



AMEND EDGE FLAGS 



S112 




S114 



YES 



FIG. 4 (con 
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CONSIDER THE NEXT EDGE IN 
THE MODEL 



S130 



DETERMINE THE NUMBER OF 
TRIANGLES SHARING THE EDGE 



S132 



S134 

IS THE 

EDGE PART OF ONLY ONE 
TRIANGLE? 

NO 



YES 



YES 



S140 



IS THE EDGE 
'SHARED BY MORE THAN 
TWO 
TRIANGLES? 



S138 



SET INVALID_EDGE_SHARING 
FLAG FOR THE EDGE FOR EACH 
TRIANGLE SHARING THE EDGE 



NO 



S136 



SET BORDER_EDGE 
FLAG FOR THE EDGE 



CONSIDER THE FIRST TRIANGLE 
SHARING THE EDGE 



S142 



IS THE 
NORMAL AT EACH 
VERTEX DEFINING THE ENDS 
OF THE EDGE PARALLEL 
TO THE TRIANGLE 
NORMAL? 



S144 



NO 



YES 



S146 



SET KEEP_EDGE FLAG FOR THE 
EDGE FOR THE FIRST TRIANGLE 



CONSIDER THE SECOND 
TRIANGLE SHARING THE EDGE 



FIG. 5 
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SET KEEP_EDGE FLAG FOR THE 
EDGE FOR THE SECOND 
TRIANGLE 





FIG. 5 (cont) 
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CONSIDER NEXT EDGE IN THE 
MODEL WHICH IS SHARED BY 
TWO TRIANGLES 



S190 




DELETE THE EDGE_NORMALS_ 

AMBIGUOUS FLAG FOR THE 
EDGE FOR THE FIRST TRIANGLE 
AND THE SECOND TRIANGLE 
SHARING THE EDGE 



S196 



DELETE THE KEEP_EDGE FLAG 
FOR THE EDGE FOR THE FIRST 
TRIANGLE SHARING THE EDGE 



S198 



SET IS_ATTACH 
FOR THE EDGE 
TRIANGLE SHAF 


ED EDGE FLAG 
FOR THE FIRST 
RING THE EDGE 




r 
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© 



1 



© ® 



SET HAS_ATTACHED_EDGE 
FLAG FOR THE EDGE FOR THE 
SECOND TRIANGLE SHARING 
THE EDGE 



S202 




DELETE THE EDGE_NORMALS_ 

AMBIGUOUS FLAG FOR THE 
EDGE FOR THE FIRST TRIANGLE 
AND THE SECOND TRIANGLE 
SHARING THE EDGE 



S206 



DELETE THE KEEP_EDGE FLAG 
FOR THE SECOND TRIANGLE 
SHARING THE EDGE 



S208 



SET IS_ATTACHED_EDGE FLAG 
FOR THE EDGE FOR THE 
SECOND TRIANGLE SHARING 
THE EDGE 



S210 



SET HAS_ATTACHED_EDGE 
FLAG FOR THE EDGE FOR THE 
FIRST TRIANGLE SHARING THE 
EDGE 
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FIG. 7 (conl 
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CONSIDER NEXT OBJECT 



S230 



CONSIDER NEXT TRIANGLE IN / 
THE MODEL 



S232 



CALCULATE ORDINATE FOR 
EACH VERTEX AND EACH 
EDGE CONTROL POINT 



S234 



CALCULATE ORDINATE FOR / 
CENTRE CONTROL POINT 



S236 




FIG. 
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FIG . 10 
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SET THE ORDINATE FOR EACH 
VERTEX CONTROL POINT TO / 
ZERO 



S250 



NO 




S252 



SET ORDINATES TO ZERO FOR 
ALL EDGE CONTROL POINTS 

ALONG EACH EDGE FOR WHICH 
BORDER EDGE FLAG IS SET 



S254 




S256 



SET ORDINATES TO ZERO FOR 

ALL EDGE CONTROL POINTS 
ALONG EACH EDGE FOR WHICH 
INVALID_EDGE_SHARING FLAG 
IS SET 



S258 



CONSIDER NEXT REMAINING 
EDGE CONTROL POINT FOR 
WHICH ORDINATE IS NOT SET 



/ 



S260 



CALCULATE DISTANCE FROM 
CONTROL POINT OF 
TANGENT PLANE WHICH 
PASSES THROUGH NEAREST 

VERTEX IN A DIRECTION 
PARALLEL TO THE NORMAL 
AT THE NEAREST VERTEX 



S262 




S264 



FIG 
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1 



CALCULATE EDGE DIRECTION 
VECTOR OF EDGE ON WHICH 

CONTROL POINT LIES IN 
DIRECTION FROM NEAREST 
VERTEX TO THE CONTROL POINT 



S280 
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r 


READ UNIT NORMAL VECTOR 
FOR CLOSEST VERTEX TO 
CONTROL POINT 




r 


CALCULATE SCALAR PRODUCT 
OF EDGE AND NORMAL 
VECTORS 




r 


MULTIPLY SCALAR PRODUCT BY 
-0.33 



/ 



S282 



S284 



S286 
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YES 



S298 

IS THIS 
THE FIRST FRAME OF 
IMAGE DATA TO BE 
^GENERATED?, 



NO 



CONSIDER MODEL OF NEXT 
OBJECT 



S300 



CONSIDER NEXT TRIANGLE IN 
THE MODEL OF THE OBJECT 



S302 



YES 



DOES EACH 
'EDGE IN TRIANGLE^ 
HAVE KEEP_EDGE, 
IS_ATTACHED_EDGE, 
BORDER_EDGE OR 
INVALID_EDGE_ 
SHARING FLAG 
SET? 



S304 



NO 



DETERMINE DEPTH OF 
TESSELLATION FOR THE 
TRIANGLE 



S306 




YES 





NO 




r 


DETERMINE GREATEST DEPTH 


OF TESSELLATION FOR THE 


MODEL 


i 


r 



S310 



® 
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FIG. 1 
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® 



YES 



READ STORED DATA 




S312 



S314 



TESSELLATE ALL TRIANGLES 
IN THE MODEL TO REQUIRED 
NEW DEPTH 



CORRECT TOPOLOGY 



STORE DATA 



S322 




S316 



S318 



S320 



YES 



NO 
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FIG. 15 (cont) 



This Page Blank fuspto) 



21/38 



1 



READ SCREEN COORDINATES 
OF EACH VERTEX OF THE 
TRIANGLE FROM PREVIOUS 
FRAME OF IMAGE DATA 



S342 



DETERMINE AREA OF TRIANGLE 
IN PREVIOUS FRAME 



S344 



READ DEPTH VALUE FROM 
LOOK-UP TABLE IN DEPENDENCE 
UPON THE TRIANGLE AREA IN 
THE PREVIOUS FRAME 



S346 



READ MINIMUM VERTEX NORMAL 
DOT PRODUCT FOR THE 

TRIANGLE FROM THE 
TOPOLOGICAL DATABASE 



S348 



READ DEPTH VALUE FROM 
LOOK-UP TABLE IN DEPENDENCE 
UPON THE MINIMUM VERTEX 
NORMAL DOT PRODUCT FOR 
THE TRIANGLE 



S350 



COMBINE DEPTH VALUES TO 
DETERMINE DEPTH OF 
TESSELLATION 



T 



S352 



FIG. 
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AREA, A, OF TRIANGLE (PIXELS) 


DEPTH VALUE 


A < SO 


i 


SO < A < 900 


o 


200 < A < 4S0 


-3 


4S0 < A < R00 


A 


800 < A < 1250 


5 


1250 < A < 1800 


6 


1800 < A < 2450 


7 


2450 < A < 3200 


8 


3200 < A < 4050 


9 


A > 4050 


10 



FIG. 17A 



MINIMUM VERTEX NORMAL DOT 
PRODUCT, DP^ 


DEPTH VALUE 


DP^ > 0.95 


1 


0.75 < DP oin < 0.95 


2 


0.50 < DP min < 0.75 


3 


0.25 < DP mln < 0.50 


4 


0.00 < DP^ < 0.25 


5 


-0.25 < DP min < 0.00 


6 


-0.50 < DP min < -0.25 


7 


-0.75 < DP mill < -0.50 


8 


-0.95 < DP min < -0.7 5 


9 


DP»m < -0.95 


10 



FIG. 17B 
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CONSIDER NEXT TRIANGLE IN THE 
MODEL 



DETERMINE BARYCENTRIC COORDINATES 
OF POINT ON ORIGINAL TRIANGLE FOR 
WHICH THE NEXT NEW VERTEX IS TO BE 
CREATED 



CALCULATE HEIGHT OF BERNSTEIN BEZIER 
PATCH ABOVE NEW POINT BY EVALUATING 
PATCH EQUATION USING BARYCENTRIC 
COORDINATES OF NEW POINT 



S360 



S362 



S364 



CALCULATE NORMAL AT NEW POINT BY 
INTERPOLATING VERTEX NORMALS FROM 
VERTICES OF ORIGINAL TRIANGLE 



CALCULATE POSITION OF NEW VERTEX AS 
POINT WHICH LIES A DISTANCE FROM THE 

ORIGINAL TRIANGLE EQUAL TO THE 
CALCULATED HEIGHT MEASURED ALONG 
THE INTERPOLATED NORMAL FROM THE 
NEW POINT 



S366 



S368 



SET NORMAL OF NEW VERTEX AS THE 
INTERPOLATED NORMAL 




S370 



1 


NO 

r 




CONNECT VERTICES 


^S374 




f 






YES 



FIG. 1 
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CONSIDER NEXT TRIANGLE IN ^ S390 
THE MODEL 



READ EDGE FLAGS FROM 
TOPOLOGICAL DATABASE FOR 
THE TRIANGLE 



S392 



NO 



IS IS_ 
ATTACHED_EDGE 
FLAT SET FOR ANY EDGE 
OF THE 
TRIANGLE?^ 



S394 




FOR EACH EDGE FOR WHICH 
THE IS_ATTACHED_EDGE FLAG 
IS SET, MOVE THE NEW 
VERTICES FOR THE EDGE 
GENERATED BY TESSELLATION 
TO MEET THE CORRESPONDING 
NEW VERTICES FOR THE 
CORRESPONDING EDGE FOR 
WHICH THE 
HAS_ATTACHED_EDGE FLAG IS 
SET 



S396 



REDISTRIBUTE NEW 
VERTICES GENERATED 
INSIDE THE TRIANGLE BY 
TESSELLATION 



S398 
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CONSIDER NEXT PAIR OF EDGES 
FOR WHICH 
AMBIGUOUS_NORMALS FLAGS 
BUT NOT KEEP_EDGE FLAGS 
ARE SET 



S404 



CONNECT NEW VERTICES 
GENERATED BY TESSELLATION 
TO GENERATE "STITCHING" 
TRIANGLES 



S406 




FIG. 22 (con 
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CONSIDER NEXT INTERNAL ^ S420 
VERTEX 



CALCULATE THE BARYCENTRIC 
COORDINATES OF THE SIX EDGE 
VERTICES CONNECTED TO THE 
INTERNAL VERTEX 



S422 



CALCULATE A WEIGHT FOR 
EACH CONNECTED EDGE 
VERTEX 



S424 



COMBINE THE POSITIONS OF 

THE CONNECTED EDGE 
VERTICES IN ACCORDANCE 
WITH THE CALCULATED 
WEIGHTS TO GIVE NEW 
POSITION FOR THE INTERNAL 
VERTEX 
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FIG. 25 
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CONSIDER NEXT OBJECT 



S450 



YES 



CALCULATE VALUE FOR EACH 
COLOUR COMPONENT AT EACH 
VERTEX IN THE MODEL 




NO 



NO 




YES 



NO 



CONSIDER NEXT TRIANGLE IN THE 
ORIGINAL MODEL OF THE OBJECT 



S464 



CALCULATE VALUE FOR EACH 
COLOUR COMPONENT AT EACH 
ORIGINAL VERTEX AND EACH NEW 
VERTEX OF TESSELATED TRIANGLES 



S466 



© ® © 

FIG. 27 
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CONSIDER NEXT TRIANGLE IN THE ^ S470 
ORIGINAL MODEL OF THE OBJECT 



CONSIDER NEXT COLOUR 
COMPONENT 



S472 



CALCULATE PARAMETERS 
DEFINING A LIGHTING PATCH FOR 
THE ORIGINAL TRIANGLE FOR THE 
COLOUR COMPONENT . 



S474 



CALCULATE VALUE FOR THE 
COLOUR COMPONENT AT EACH 
VERTEX OF EACH TESSELATED 
TRIANGLE USING THE LIGHTING 
PATCH 



S476 




FIG. 27 (con 
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i 



CALCULATE VALUE FOR THE COLOUR 
COMPONENT AT EACH CONTROL 
POINT OF THE TRIANGLE 


^S500 




f 




DEFINE A POINT ABOVE EACH 
CONTROL POINT AT A HEIGHT 
CORRESPONDING TO THE 
CALCULATED VALUE OF THE COLOUR 
COMPONENT AT THAT CONTROL 
POINT 


^S502 




< 






r 




CONSIDER NEXT EDGE OF THE 
TRIANGLE 


^S504 




r 




CALCULATE ORDINATES FOR THE 
EDGE WHICH CAUSE BERNSTEIN 

BE2IER PATCH TO INTERPOLATE THE 
DEFINED POINTS ABOVE THE 

CONTROL POINTS ALONG THE EDGE 


^S506 


ANOTHER ^"^-^^ 


YES 



EDGE? 



NO 





CALCULATE ORDINATE FOR THE 
CENTRAL CONTROL POINT 




1 


r 



FIG 
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410^.' 



hO 



400 



hi 



412 



414 



418 



h2 



402 



404 



416 

h3 
406 



TRIANGLE EDGE 



FIG. 29A 



410 



400 




LIGHTING PATCH EDGE 



TRIANGLE EDGE 



FIG. 29B 
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SET: "SUM" = 0 



S520 



CONSIDER NEXT CONTROL POINT 
LYING ON AN EDGE BETWEEN 
VERTICES 



S522 




OF COLOUR COMPONENT, AND 
ADD RESULTANT TO "SUM" 




DEFINE ORDINATE FOR CENTRAL 
CONTROL POINT AS POINT AT HEIGHT 
OF 1/6 x "SUM" x VALUE OF COLOUR 
COMPONENT AT CENTRAL CONTROL 
POINT 



S532 



FIG. 30 
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CONSIDER NEXT VERTEX 



S550 



DETERMINE BARYCENTRIC 
COORDINATES OF POINT ON ORIGINAL 
TRIANGLE TO WHICH THE VERTEX 
CORRESPONDS 



S552 



CALCULATE HEIGHT OF BERNSTEIN 
BEZIER LIGHTING PATCH ABOVE THE 
POINT ON THE ORIGINAL TRIANGLE BY 
EVALUATING LIGHTING PATCH 
EQUATION USING THE DETERMINED 
BARYCENTRIC COORDINATES 



S554 



ANOTHER 
VERTEX? 



YES 



NO 

FIG 
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